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Abstract 

This  thesis  describes  an  interface  to  a  true  diree  dimensional,  real-time  dynamic 
graphic  display,  the  TI  Omniview™.  The  system  generates  true  3-D  images  of  volumetric 
data  and  objects.  The  interface  provides  the  user  with  a  quick  and  flexible  means  of 
manipulating  the  image  generated,  the  sub-volume  displayed,  and  the  resulting  3-D  image. 
This  interface  allows  the  user  to  select  objects  and  scenes,  but  does  not  allow 
manipulation,  such  as  rotation  or  placement,  of  individual  objects.  Location  and 
orientation  of  all  objects  is  based  on  information  received  across  a  network. 

Generating  a  two-dimensional  image  from  a  three-dimensional  data  set  reduces  the 
information  content  and  produces  an  inherent  ambiguity.  A  three-dimensional  display  is 
needed  to  represent  the  full  data  of  the  3-D  world.  One  of  the  newest  true  three- 
dimensional  display  devices  is  the  TI  Omniview.  The  Onuiiview  is  a  cylindrical 
volumetric  laser  display  that  uses  a  rotating  double-helix  translucent  disk  to  fill  the 
display  cylinder.  The  helical  display  disk  rotates,  defining  a  cylindrical  volume.  Voxels 
are  illuminated  on  the  2-D  surface  in  the  cylindrical  volume.  The  rotational  speed  of  the 
disk  allows  the  viewer  to  fuse  the  2-D  images  into  a  true  3-D  image.  This  3-D  image 
provides  several  depth  cues  by  using  head  motion  parallax,  accomnx)dation,  convergence, 
and  binocular  disparity.  The  display  can  be  simultaneously  viewed  from  all  angles  by 
many  viewers. 
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The  goal  of  this  research  was  to  provide  the  user  the  ability  to  control  and 
manipulate  the  3-D  image  in  the  Omniview.  To  achieve  this  goal,  an  interface  to  the 
device  that  permits  direct  user  interaction  with  and  control  of  the  display  was  developed. 
1  designed  and  implemented  an  interactive  interface  to  the  true  3-D  device  that  provides 
the  user  with  the  flexibility  and  convenience  that  a  window,  icon,  mouse,  and  pointer 
(WIMP)  graphical  user  interface  (GUI)  provides  to  users  of  2-D  displays.  Limitations  of 
the  device,  however,  do  not  allow  the  use  of  icons  and  pointers  in  the  Omniview  display. 
Instead  a  combination  of  voice  commands,  a  joystick,  and  a  2-D  menu  system  running 
on  a  host  computer  is  used  to  provide  the  interface. 
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A  USER  INTERFACE  TO  A  TRUE  3-D  DISPLAY  DEVICE 


/.  Introduction 


General  Issue 

This  thesis  describes  the  development  of  an  interface  to  a  true  three 
dimensional,  real-time  dynamic  graphic  display,  Ae  TI  Omniview™.  The  system  is 
designed  to  generate  true  3-D  images  of  volumetric  data  and  objects.  The  interface 
provides  Ae  user  wiA  a  quick  and  flexible  means  of  manipulating  Ae  image 
generated,  Ae  objects  displayed,  and  Ae  resulting  3-D  image.  It  allows  selection  of 
objects  and  scenes.  It  does  not  allow  manipulations,  such  as  rotation  or  placement,  of 
inAvidual  objects. 

Background 

Motion  parallax  provides  important  clues  for  understanding  inherently  3-D 
scenes  where  group  viewing  and  mteraction  are  required  (WILL92).  Volume 
visualization,  m  Ae  form  of  a  true  3-D  display,  is  a  key  research  and  development 
technology  Aat  can  meet  group  viewing  and  interaction  requirements.  The  TI 
Omniview  is  one  such  true  3-D  display.  The  Omniview  allows  Ae  Asplay  of  air 
tactics  analysis  and  satellite  orbital  analysis  scenarios  where  many  can  view  Ae 
maneuvers  m  three  dimensions,  from  all  angles  (WILL92). 


In  general,  graphics  literature  has  seldom  addressed  true  3-D  volumetric 
displays  in  which  the  image  occupies  a  volume,  because  a  generic,  robust  true  3-D 
display  device  has  not  existed  The  most  widely  available  and  best  known  true  3-D 
device  is  the  varifocal  mirror.  Even  with  the  limitations  of  image  size  and  device 
availability,  research  has  been  performed  on  interactively  controlling  the  image 
displayed  on  the  varifocal  mirror. 

Research  Objectives 

The  purpose  of  this  thesis  .vas  to  design  and  implement  an  interactive  interface 
to  a  true  3-D  display.  The  system  was  designed  for  users  with  expertise  in  their  own 
field  but  not  in  the  field  of  computer  science  or  Omniview  operations.  Therefore,  the 
user  of  the  system  must  have  control  of  the  content  of  the  image  without 
understanding  the  underlying  Omniview  operational  characteristics,  computer  data 
structures,  or  algorithms.  This  interface  was  an  attempt  to  develop  an  interactive 
interface  to  a  true  3-D  display  device  that  provides  the  user  the  same  flexibility  and 
convenience  that  a  window,  icon,  mouse,  and  pointer  (WIMP)  graphical  user  interface 
(GUI)  provides  to  users  of  2-D  displays.  To  achieve  this  goal,  an  interface  was 
developed  to  permit  direct  user  interaction  with  and  control  of  the  image  displayed. 

This  thesis  addresses  the  3-D  display  and  control  issues  in  using  the  Omniview 
for  the  display  of  the  SIMNET  battlefield.  The  following  specific  questions  were 
addressed.  How  should  a  user  of  the  Omniview  interactively  control  the  numbers, 
types  and  scales  of  the  objects  and  the  portion  of  the  SIMNET  battlefield  being 
displayed?  What  user  controls  of  the  displays  are  needed  and  how  should  these 
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controls  be  provided?  What  are  the  benefits  and  disadvantages  of  various  user 
interface  devices  including:  dataglove,  joystick,  spaceball,  three  button  mouse,  and 
voice  commands  to  control  the  display  while  viewing  the  Omniview?  What  is  the 
potential  for  controlling  the  display  via  a  menu  and  icon  based  command  console 
monitor? 

Materials  and  Support 

The  On  .liview  display  is  controlled  by  a  custom  built  VME  based  interface 
card.  The  graphics  processing,  user  interface,  and  VME  support  are  provided  by  a 
Sun  4/470.  The  Omniview  and  local  development  stations  both  required  network 
connection  for  TCP/IP  and  network  connections  to  SIMNET.  Local  developm  nt  was 
performed  on  a  Sun  4/260  computer  and  Silicon  Graphics  4D/440  system.  An 
emulator  for  the  3-D  display  of  the  Omniview  was  developed  on  the  Silicon  Graphics 
4D  system.  The  use  of  the  Silicon  Graphics  system  allowed  the  display  of  the  image 
on  a  pseudo  3-D  hyperbolic  mirror  display.  Software  required  on  the  Sun  included  the 
GNU  C++  compiler,  X  library  and  Motif  interface. 

Benefits  of  Research 

This  thesis  resulted  in  an  interactive  interface  to  a  true  3-D  system.  The  users 
of  the  system  were  able  to  control  the  image  generated  either  through  the  WIMP  GUI 
or  the  direct  manipulation  devices,  joystick  and  voice  commands,  while  viewing  the 
Omniview.  The  usefulness  of  a  3-D  display  device  can  be  enhanced  by  an  interface 
that  allows  a  user  to  explore  and  limit  the  3-D  volume  presented. 
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The  lessons  learned  and  application  denaonstration  will  introduce  the  computer 
graphics  community  to  a  new  true  3-D  display  device.  The  specific  benefit  of  this 
research  is  that  it  will  provide  multiple  viewers  a  single  point  data  fusion  center  to 
observe  a  SIMNET  battle  in  true  3-D.  All  information  gathered  will  be  directly 
applicable  to  the  visualization  of  Red  Flag,  Green  Flag,  and  other  training  exercises 
and  be  extendable  to  air  traffic  control  displays  as  additional  systems  become 
available. 

Thesis  Overview 

This  thesis  contains  five  chapters.  Chapter  2  is  a  literature  review  which 
covers  the  major  technologies  available  for  displaying  and  controlling  three- 
dimensional  images.  Chapter  3  explains  the  methodology  used  to  design  the  user 
interface.  Chapter  4  covers  the  characteristics  of  the  Omniview  image  generated  to 
display  the  SIMNET  battlefield.  Chapter  5  reports  the  results  of  this  thesis,  suggests 
future  research  and  provides  final  comments. 
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II.  Uteratwre  Review 


Introduction 

The  extension  of  computer  graphics  into  three  dimensions  is  driven  by  the 
capability  of  the  human  visual  system  to  perceive  and  comprehend  the  woiid  in  three 
dimensions  (WICH91).  Generating  a  two-dimensional  image  from  a  three-dimensional 
data  set  reduces  the  information  content  (FUCH89)  and  produces  an  inherent 
ambiguity  (WICK90).  A  three-dimensional  display  is  needed  to  represent  the  full 
complexity  of  the  3-D  world. 

The  major  technologies  available  for  displaying  three-dimensional  images  are 
reviewed.  Stereo  pair  projection  is  a  2-D  display  that  gives  the  illusion  of  3-D.  True 
3-D  displays  reviewed  include  the  holographic  stereogram,  varifocal  mirror,  and 
Omniview.  A  brief  description  followed  by  advantages  and  disadvantages  is 
presented,  for  each.  Input  devices  for  controlling  3-D  images  are  also  reviewed. 

3-D  Display  Technologies  Reviewed  (BUDI84;  LIPT92;  STAR92) 

Stereo  Pair  (BRYS92;  HODG91;  LANE82;  ROBI91). 

One  of  the  least  expensive  and  most  readily  available  three-dimensional 
display  devices  is  the  stereo  pair  display.  Different  2-D  images  are  directed  to  the  left 
and  right  eye.  Stereo  pair  devices  can  be  divided  into  two  categories:  time 
multiplexed  and  time  parallel.  Time  multiplexed  systems  r^idly  altonate  the  left  and 
right  eye  perspective  views  on  a  single  display  and  use  a  shutter  mechanism  to 
synchronize  the  correct  view  to  each  eye  (BRYS92;  KIMW92).  Time  parallel  systems 
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present  left  and  right  eye  views  simultaneously  on  separate  or  a  single  split  display 
and  require  special  apparatus  to  deliver  the  correct  perspective  view  to  each  eye 
(HODG87;  KIMW92).  Stereo  pair  displays  depend  on  binocular  disparity,  which  is 
the  difference  in  images  cast  by  the  same  object  as  projected  on  the  left  and  right  eyes 
when  viewing  a  3-D  scene  (WICK90),  to  produce  the  separation  of  depth  and 
normally  require  special  viewing  devices.  3-D  or  polarized  lens  glasses  are  required 
for  passive  systems  and  shutter  devices  for  active  systems. 

Stereo  pair  devices  are  attractive  for  several  reasons.  They  are  the  least  costly 
devices  considered  and  provide  the  greatest  resolution.  A  high  resolution  CRT  can  be 
the  driving  device.  Using  the  high  resolution  raster  graphic  CRT  enables  true  colors, 
shading,  hidden  line  removal  and  a  wide  range  of  interactive  manipulation  methods. 

There  are  several  drawbacks  to  stereo  pair  displays.  A  large  number  of  people, 
approximately  10%,  have  some  degree  of  stereo  blindness.  They  are  unable  to  fuse 
the  left  and  right  images  to  perceive  a  complete  3-D  image  (WILL92).  Stereo  pairs  do 
not  have  look  around  properties.  The  viewer  focuses  only  at  the  plane  of  the  stereo 
pair.  Accommodation,  change  in  focal  length  of  the  eye’s  lens  as  it  focuses  on  a 
speciHc  region  of  a  3-D  scene  (WICK90),  is  fixed.  The  depth  cues  of  accommodation 
and  convergence,  rotation  of  the  eyes  inward  to  converge  on  objects  as  the  objects 
move  closer  to  the  observer  (WICK90),  are  thus  disconnected.  The  computations 
required  to  generate  the  correct  images  needed  to  fonn  the  stereo  image  can  be 
difficult  (HODG91;  ROBI91). 
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Holographic  Stereogram  (BENT82;  HUAN71;  MOUS90;  STUA90). 

A  holographic  stereogram  uses  holographic  techniques  to  record  a  series 
of  perspective  views  of  a  scene  in  such  a  way  that  each  view  is  visible  only  when  the 
observer’s  eye  is  in  the  correct  orientation  relative  to  the  holographic  film  plane 
(HODG87).  To  produce  a  hologram,  the  interference  pattern  produced  by  two  laser 
beams  originating  finom  the  same  source  is  recorded  on  a  very  high  resolution 
photographic  medium.  One  beam  strikes  the  recording  medium  directly,  and  the  other 
beam  bounces  off  the  objects  in  the  scene  and  interferes  with  the  reference  beam.  To 
generate  a  computer-generated  hologram,  the  object  need  not  exist  because  wave 
propagation  can  be  simulated  mathematically.  Wave  propagation  coiiq>uted  using 
Fraunhofer,  Fresnel,  or  near-field  diffraction  theories  generates  the  interference  pattern 
(TRIC87).  The  recorded  interference  pattern  allows  the  reconstruction  of  the  original 
scene  (UNTE87). 

A  benefit  of  the  holographic  stereogram  is  that  it  provides  realistic  depth-of- 
field.  Even  though  the  hologram’s  appearance  differs  from  that  of  the  real  object,  the 
resulting  image  can  be  remarkably  realistic  (TRIC87).  Disadvantages  of  the 
holographic  stereogram  include  the  lack  of  true  color  and  the  time  needed  to  produce 
an  image.  This  long  production  time  does  not  permit  interactive  manipulation  of  the 
computer-generated  images  (HODG87).  A  single  3-D  scene  requires  the  generation  of 
108  perspective  views  to  achieve  a  36-degree  field-of-view  image.  A  hologram  can  be 
simultaneously  viewed  by  only  two  or  three  viewers;  larger  audiences  are  beyond  the 
state-of-the-art. 
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Varifocal  Mirror  (HARR88;  LANE82;  LIPT92;  SHER88). 

The  variable  focal  length  miiror  was  first  introduced  by  J.C.  Muirhead 
in  1960  (MUIR61).  Soon  after,  it  was  used  U)  create  a  3-D  display  device  (FUCH82). 
The  Mayo  Clinic  True  Three-Dimension  Machine  (ROBB89;  STYT91)  is  another 
example  of  a  system  using  the  varifocal  display  to  generate  a  true  3-D  image.  A 
circular  varifocal  mirror  is  used  to  reflect  an  image  from  a  point  plotting  CRT.  The 
viewer  observes  the  reflection  of  the  screen  on  the  mirror.  The  mirror  is  oscillated  by 
driving  it  with  a  30Hz  audio  signal,  the  mirror  deformation  causes  the  image  to  appear 
extended  in  depth.  Driven  at  30Hz,  the  device  displays  30  frames  per  second,  the 
maximum  display  image  is  2Sx2Sx25cm  with  128x128  points  displayable  pa*  frame 
(FUCH82).  The  position  of  the  mirror  determines  the  apparent  depth  of  the  point  in 
the  image  volume.  The  point  appears  correct  if  it  is  displayed  within  0.1  inches  of  its 
desired  position  (FUCH82).  The  depth  at  which  the  point  appears  is  controlled  by  the 
scheduling  of  the  point  in  the  display  list.  Any  collection  of  3-D  points  within  the 
image  volume  can  be  displayed  by  scheduling  each  3-D  point  at  the  correct  location  in 
the  refresher  buffer.  Three-dimensional  perception  is  obtained  when  the  human  eye 
fuses  the  rapidly  changing  2-D  image  into  a  3-D  image  (FUCH89). 

The  varifocal  mirror  provides  several  benefits.  The  display  can  be  viewed  by 
several  observers,  over  a  range  of  distances  within  a  limited  solid  angle  (RAWS69). 
The  depth  cues  of  binocular  disparity  and  head  motion  parallax,  differences  in  views 
of  a  scene  by  moving  the  scene  or  the  observer  (WICK90),  are  provided  inherently  by 
the  nature  of  the  display  (FUCH82). 
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The  disadvantages  of  the  varifocal  mirror  are  a  result  of  all  images  being 
transparent  The  depth  cue  of  interposition,  the  obscuring  of  further  portions  of  a 
scene  by  nearer  portions,  is  missing  (RAWS69).  Hidden  line  removal  has  no  meaning. 
This  can  cause  confusion  when  viewing  images  with  high  information  content  It  may 
also  be  difficult  to  understand  depth  relationships  since  the  viewer  can  be  swamped 
with  information  (HODG87).  Color  images  are  not  possible  because  a  color  point 
plotting  CRT,  with  phosphor  decay  sufficiently  fast  to  eliminate  snoear,  is  not 
available.  This  limits  the  varifocal  mirror  display  to  monochrome. 

Omniview. 

One  of  the  newest  true  three-dimensional  display  devices  is  the  TI 
Omniview  (LIPT92;  WILL92).  The  display  principle  is  similar  to  that  of  the  varifocal 
mirror.  Points  illuminate  a  2-D  surface  in  a  cylindrical  volume  such  that  the  viewer 
fuses  the  images  into  a  3-D  image.  However,  ratiier  than  using  a  vibrating  mirror,  the 
Omniview  is  a  cylindrical  volumetric  laser  display  that  uses  a  rotating  double-helix 
translucent  disk  to  fill  the  display  cylinder  (Figure  1).  The  helical  display  disk  rotates 
at  6(X)  ipm  thereby  defining  a  cylindrical  volume.  The  rapidly  rotating  surface  (disk) 
within  the  cylindrical  display  volume  provides  the  surface  on  which  images  are  drawn. 

The  current  system  provides  a  large  display  volume,  36  inches  in  diameter  and 
18  inches  high.  Voxels  to  be  colored  are  illuminated  by  lasers.  The  lasers  are 
directed  to  the  voxels  to  be  illuminated  by  acousto-optic  scanners.  A  voxel  is  2.Smm 
in  diameter  and  can  be  displayed  as  red,  green,  blue,  or  no  color.  Of  the  67  billion 
addressable  voxels,  4,(X)0  each  for  red,  green,  and  blue,  can  be  displayed  during  one 
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Figure  1.  TI  Omniview  Display 

rotation.  The  number  of  displayable  voxels  is  limited  by  the  response  time  of  the 
acousto-optic  scanners. 

The  Omniview  provides  several  advantages  by  producing  a  true  3-D  image. 
The  image  provides  several  depth  cues  including  head  motion  parallax, 
accommodation,  convergence,  and  binocular  disparity  (WICK90).  The  display  can  be 
simultaneously  viewed  from  all  angles  by  many  viewers  (WILL92).  Color  images  are 
a  major  benefit  with  the  Omniview;  however,  only  three  basic  colors  are  possible. 
Attempting  to  combine  the  three  colors  into  additional  colors  is  not  possible  because 
of  limitations  in  laser  positioning.  Illuminating  the  same  point  with  different  colors 
will  yield  separate  voxels  for  each  color.  The  voxels  may  or  may  not  overlap. 

The  current  Omniview’s  disadvantages  include  flicker,  a  limited  number  of 
concurrently  displayable  points,  aliasing,  and  frame  rate  (WIIX91).  At  600  rpm,  each 
frame  requires  0.1  sec  to  be  displayed.  Points  on  the  double-helix  surface  near  the 
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center  of  the  helix  in  height  (z)  are  updated  at  near  20Hz.  Points  near  the  top  and 
bottom  of  the  voluim  are  updated  very  close  in  time  making  the  update  occur  at  lOHz, 
thereby  increasing  flicker.  Even  at  a  20Hz  update  rate,  the  human  eye  perceives 
flicker.  Fine  lines  and  small  details  are  not  possible  to  produce  due  to  voxel  size. 

The  scheduling  algorithm  used  to  light  voxels  introduces  aliasing  in  the  image. 
Hardware  limitations  prevent  the  device  from  achieving  the  theoretical  maximum  of 
12,000  voxels  lit  at  a  time.  Another  disadvantage  is  that  the  voxels  are  transparent. 
Transparency  can  cause  confusion  when  viewing  images  with  high  information  content 
(HODG87).  The  depth  cue  of  interposition  or  occlusion  results  when  the  nearer  of 
two  objects  obscures  the  more  distant  object  and  is  missing  from  the  Chnniview. 
Hidden  line  removal  has  no  meaning  because  all  images  are  transparent  and  the  image 
can  be  viewed  from  all  sides.  This  can  make  it  difficult  for  the  viewer  to  understand 
depth  relationships  if  the  viewer  is  overloaded  with  information.  Research  to  improve 
the  performance  of  the  Omniview  is  currently  underway.  Issues  including  reducing 
flicker,  increasing  frame  rate,  increasing  pixel  count,  adding  true  colors,  and  metrics 
for  evaluating  volumetric  laser  displays  (WILL91)  are  being  addressed. 

Input  Devices  for  Controlling  3-D  Images  (BRYS92;  FELG92;  HALL92;  JAC092) 
Several  devices  are  available  for  controlling  an  image  in  a  2>D  or  3-D 
environment  (BUXT83).  The  suitability  of  the  input  device  is  dependent  on  the 
perfoimance  of  the  system,  the  performance  required  by  the  user,  and  the  application 
interface  type  (FELG92).  In  desktop  applications  the  user  can  select  and  change  input 
devices  and  works  in  front  of  the  woik  station.  Virtual  environments  present  a 
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different  set  of  problems.  Head  mounted  display  users  are  immersed  in  the 
application.  Users  cannot  watch  where  input  devices  are  physically  located,  the  input 
devices  must  also  be  rendered  in  the  scene.  Input  devices  used  in  an  immersive 
environment  may  be  a  body  part  such  as  the  hand  or  head. 

Input  devices  can  be  categorized  by  the  degrees  of  freedom  they  provide  the 
user.  Discrete  inputs  include  buttons,  switches,  and  recognized  voice  commands.  The 
range  of  values  are  yes  or  no,  on  or  off.  One  degree  of  freedom  devices  include 
sliders,  dials,  and  wheels.  Separate  control  is  provided  for  each  axis.  Two  degrees  of 
freedom  are  provided  using  a  mouse,  trackball,  tablet,  or  joystick  input  device.  Three 
degrees  of  freedom  can  be  provided  by  a  3-D  joystick.  Six  degrees  of  freedom  can  be 
provided  with  a  Spaceball  or  tracking  devices  including  the  DataGlove  and  poolball. 

Discrete  Input  Devices.  Buttons,  switches  and  keyboards  provide  discrete 
inputs.  Voice  commands  also  provide  such  input  to  an  application  (BRYS92; 
JACC)92).  Controlling  a  scene  through  voice  commands  has  several  advantages  over 
other  input  devices.  Voice  recognized  commands  do  not  require  the  use  of  hands, 
they  may  be  involved  in  other  manipulation  tasks.  Voice  conunands  are  unobtrusive 
in  the  environment  and  the  user  does  not  have  to  remember  the  location  of  the  input 
device.  Major  disadvantages  of  voice  controls  are  difficulty  of  setup  and  lack  of 
reliability  in  recognizing  the  commands  given.  Whenever  voice  input  was  used, 
keyboard  equivalents  were  also  implemented  (JAC092). 

One  Degree  of  Freedom  Input  Devices. 

Dial  Box  or  Rotary  Pot  (BEAT87;  BUXT83;  FELG92).  Various 
configurations  for  dial  boxes  exist  One  type  features  eight  individual  dials,  three  for 
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translation,  three  for  rotation,  and  the  remaining  two  dials  for  selecting  and  deselecting 
objects.  The  benefits  of  dial  boxes  include  precise  and  direct  control  for  movement  in 
each  direction,  with  each  axis  being  controlled  separately.  The  disadvantages  include 
unnatural  interaction,  the  firequency  of  choosing  the  wrong  dial  to  turn,  and  in  many 
cases  the  required  use  of  two  hands  to  perform  the  desired  tasks. 

Sliders  or  Sliding  Pot  (BIJXT83;  CHEN88).  Adjustment  about  one 
axis  or  translation  in  one  direction  is  provided  by  each  slider.  Typically  the  user 
adjusts  the  x,  y,  and  z  sliders  to  indicate  position  in  each  of  the  directions.  Sliders  can 
also  be  used  to  indicate  the  rotation  about  each  of  the  primary  axes. 

Two  Degrees  of  Freedom  Input  Devices.  Two  degrees  of  fteedom  devices 
allow  positioning  or  moving  in  two  dimensions  while  moving  one  device  or  input 
mechanism.  These  2-D  devices  often  require  elaborate  software  solutions  to  make 
them  perform  in  3-D  worlds. 

Mouse  (BEAT87;  BUXT83;  CHEN88;  FELG92).  The  mouse  easily 
provides  2-D  translation  and  can  cause  translations  in  different  planes  with  the  use  of 
decoding  buttons.  For  example,  the  left  button  could  cause  translation  in  the  xy-plane 
while  the  left  and  middle  button  could  cause  translation  in  the  xz-plane.  The  middle 
mouse  button  could  be  used  for  rotation  about  a  principle  axis,  such  as  the  z  axis. 

The  right  button  could  be  used  for  selecting  and  deselecting  an  object.  The  main 
advantages  of  the  mouse  are  user  familiarity  with  its  operation  and  ease  of  2-D 
translations.  Disadvantages  include  unnatural  interaction.  Complex  tasks  must  be 
broken  down  into  simpler  operations,  for  example  rotation  about  an  arbitrary  axis. 
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Moving  the  mouse  while  pressing  one  or  two  buttons  interferes  with  precise  control  of 
positions. 

Trackball  (BUXT83).  Trackball  operation  is  similar  to  a  mouse  and  can 
be  thought  of  as  an  upside  down  mouse.  One  benefit  over  the  mouse  is  that  the 
trackball  does  not  require  an  area  to  move  the  ttevice  over.  Movement  of  the  ball 
causes  changes  in  position.  A  disadvantage  over  the  mouse  is  the  difficulty  some 
users  find  in  precisely  controlling  positioning. 

Joystick  (BUXT83).  The  joystick  provides  two  degrees  of  freedom. 
Positioning  information  can  be  taken  directly  from  the  position  of  the  joystick, 
however  this  limits  the  positioning  accuracy.  A  more  intuitive  interface  is  to  change 
position  based  on  the  stick  position  providing  velocity  and  direction  of  moveirrent 
Releasing  the  joystick  to  the  center  position  stops  the  movement  at  its  current  position. 

Three  Degrees  of  Freedom  Input  Devices. 

3~D  Joystick  (BIJXT83).  The  3-D  joystick  functions  the  same  as  a  2-D 
joystick  with  the  addition  of  a  third  degree  of  movement  This  movement  is  provided 
by  moving  the  joystick  about  the  z-axis,  by  either  pushing  or  pulling  the  stick. 

Positioning  movement  about  the  x-,  y-,  and  z-axes  is  then  provided. 

Joybox  (HOLL92).  The  UNC  Chapel  Hill  joybox  includes  a  pair  of 
three  degrees  of  fr:eedom  joysticks  and  a  slider.  One  joystick  can  be  used  for 
positioning  while  the  other  joystick  is  used  for  rotational  values.  This  device  starts 
providing  the  functionality  desired  by  six  degrees  of  freedom  control  devices. 

Six  Degrees  of  Freedom  Input  Devices.  Six  degrees  of  freedom  devices  are 
multidimensional  and  provide  users  with  intuitive  three-dimensional  interaction  capabilities. 
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Spacebcdl  (BRYS92;  FELXj92).  The  spaceball  provides  six  degrees  of 
freedom  from  a  force/torque  controller.  It  provides  three  force  conqwnents  and  three 
torque  components.  Force/torque  can  be  mapped  to  position  but  this  is  not  the  most 
effective  control  (BRYS92).  Force/torque  devices  sense  force  which  is  coupled  to  the 
second  derivative  of  position.  Most  users  are  not  very  good  at  controlling  force. 
Absolute  position  based  on  force  is  not  very  accurate  or  intuitive.  Releasing  the  ball 
would  return  the  position  to  zero.  Mapping  forceAorque  to  velocity  proved  to  be  a 
more  intuitive  and  precise  operation  for  many  users,  where  translation  and  rotation  of 
objects  can  be  simultaneously  performed.  A  button  on  the  spaceball  can  be  used  to 
select  and  deselect  an  object  (FELG92). 

The  spaceball  may  be  difficult  to  use  when  the  force/torque  is  used  for 
positioning.  When  position  is  based  on  force  the  user  must  be  map  pressing  and 
twisting  a  ball  into  position,  if  the  mapping  was  not  to  velocity  by  the  application 
software.  Errors  in  positioning  occur  using  the  spaceball  when  the  force  applied  is  not 
in  line  with  the  center  of  the  ball.  Torque  will  be  generated  causing  rotation.  This 
can  be  overcome  by  operating  the  ball  in  either  force  only  or  torque  only  naode  and 
using  a  button  to  toggle  between  the  two  modes. 

DataGlove  (BRYS92;  FELG92;  HOLL92;  JACX>92).  Six  degrees  of 
freedom  are  provided  in  the  DataGlove  by  an  electromagnetic  tracking  device  such  as 
the  3Space  Isotrack  from  Polhemus.  The  DataGlove  is  then  used  with  gesture 
recognition  software.  The  glove  gives  information  about  the  angle  of  all  of  the  joints 
in  the  user’s  hand.  The  application,  gesture  recognition  software,  must  ccHnpress  this 
information  into  a  small  number  of  gestures.  The  glove  measures  ten  values  at  the 
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joints  of  the  fingers.  These  values  are  then  compared  to  trained  and  calibrated 
measures  to  recognize  the  gesture  being  made.  Advantages  include  intuitive 
interaction  (FELG92).  Selecting  and  releasing  objects  by  grabbing  the  object  is  easy. 
An  objects  is  selected  with  a  Hst  gesture  and  released  with  an  open  hand  (FELG92). 
Tracking  maps  the  translation  and  rotation  into  absolute  space  information. 
Disadvantages  include  difficulty  in  gesture  recognititHi.  Researchers  at  UNC  Chapel 
Hill  have  found  it  simpler  to  encode  the  gesture  using  the  buttons  on  the  poolball  than 
to  decode  the  glove  (HOLL92).  The  DataGlove  requires  calibration  for  every  user  and 
for  each  use.  Tracking  was  slow.  In  general  the  DataGlove  has  more  degrees  of 
freedom  than  most  applications  need  or  want. 

Poolball  (HOLL92).  The  poolball  is  a  hollowed-out  billiard  ball  with  a 
Polhemus  sensor  on  the  inside  and  two  buttons  on  the  outside  (HOLL92).  The 
poolball  was  found  to  be  easier  to  use  and  more  precise  than  the  DataGlove. 
Advantages  of  the  poolball  include  that  it  does  not  require  calibration  for  each  user, 
position  can  be  accurately  specified  at  all  times,  and  actions  initiated  with  die  buttons 
are  easy  to  control  precisely.  The  poolball  is  limited  in  die  number  of  states  generated 
by  the  buttons;  two  buttons  yield  four  states. 

Conclusion 

The  use  of  computer  graphics  to  present  3'D  images  has  increased  as  the 
availability  and  capabilities  of  displays  has  increased.  The  holographic  stereograms 
currently  are  not  feasible  for  interactive  gnqihics.  The  varifocal  minor  has  not 
progressed  and  is  extremely  limited  in  use  with  little  advancement  or  research  being 
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conducted.  Stereo  pair  devices  are  being  increasingly  used  with  much  research  in 
progress.  The  TI  Omniview  is  new  and  general  experience  with  the  device  is 
extremely  limited.  Currently  there  are  only  two  Omniview  display  devices  in 
existence  and  access  to  them  is  severely  restricted  (WILL92P).  A  summary  of 
capabilities  of  the  3-D  display  technologies  reviewed  appears  in  Table  1  as  reviewed 
by  Hodges  (HODG87)  with  the  addition  of  the  Onaniview. 

The  problem  of  how  best  to  use  this  type  of  display  and  how  to  allow  the  user 
to  manipulate  the  image  must  also  be  addressed.  In  the  next  chapter  an  interface  for 
manipulating  the  image  in  the  Omniview  is  discussed. 
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Table  1 


Con^arison  of  3-D  Technologies 


Holographic 

Stereogram 

Varifocal 

Mirror 

Stereo  Pair 

Omni  view 

Shaded  Model 

Fair 

No 

Excellent 

No 

Features  may  be 
represented  by 
color  codes 

No 

No 

Excellent 

Fair  1 

Interactive 
operations  on 
image  being 
viewed 

No 

Fair 

ExceUent 

Good  1 

Interactive 
overlay  of 

DFAD  features 
onto  DTED 
terrain 

No 

Fair 

Good 

Fair 

Display  of  entire 
DTED  square 
possible 

Good 

No 

Good 

No 

Ergonomics 

Fair 

Good 

Fair 

Poor 

Multiple  viewers 

Fair 

Fair 

Excellent 

Excellent 

Quality  of  depth 
effect 

Excellent 

Excellent 

Excellent 

Good 
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III.  Methodology  Used 


Introduction 

The  goal  of  this  research  was  to  provide  the  user  the  ability  to  control  and 
manipulate  the  3-D  image  in  the  Omniview.  Many  interfaces  to  the  varifocal  minor 
can  be  characterized  as  being  command  line  driven  to  control  the  display  device  and 
the  objects  to  be  displayed.  We  developed  an  intouctive  interface  to  a  true  3-D 
device  that  provides  the  user  with  the  flexibility  and  convenience  that  a  window,  icon, 
mouse,  and  pointer  (WIMP)  interface  provides  to  users  of  2-D  displays.  As  a  step 
toward  attaining  this  goal,  we  developed  an  interface  to  the  device  that  permits  direct 
user  interaction  with  and  control  of  the  display.  In  our  design  for  the  interface,  we 
chose  to  structure  it  so  that  users  familiar  with  WIMP  interfaces  can  readily 
understand  and  use  the  true  3-D  device  to  display  the  environment  of  interest. 

Display  Ertvironment  and  Requirements 

The  environment  being  depicted  directly  impacts  the  user  controls  required. 
When  the  environment  contains  many  items,  too  much  information  in  the  display  hides 
the  information  of  importance  (HODG87).  The  user  must  be  allowed  to  select  which 
information  is  important  and  should  be  displayed.  The  image  then  must  be  generated 
with  due  consideration  to  the  resolution  available  and  to  the  limited  voxel  budget. 

One  limitation  of  the  Omniview  is  that  textual  information  is  not  easily 
displayed  in  the  volume.  This  is  due  to  several  factors.  First,  since  the  display  is 
viewable  from  360  degrees,  a  single  location  for  the  text  is  not  appropriate  for  all 
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viewers;  only  some  viewers  would  see  the  text  correctly.  The  other  difficulty  with 
text  is  resolution  and  voxel  budget.  A  simple  alpha-numeric  character  set  can  easily 
require  5-30  voxels  per  character.  With  a  best  case  of  oirly  4,000  voxels  of  any  one 
color,  100  characters  is  close  to  the  voxel  budget  We  therefore  chose  to  eliminate 
text  from  the  Omniview  portion  of  the  interface. 

The  environment  displayed  is  dynamic  with  objects  entering  and  leaving  the 
world  at  any  time.  Multiple  events  and  simultaneous  activities  can  take  place.  One 
example  of  this  type  of  environment  is  an  airport  where  aircraft  are  taking  off  and 
landing.  Other  aircraft  traverse  the  area  at  higher  altitudes  and  ground  vehicles 
support  aircraft,  move  cargo,  and  move  people.  Another  example  is  satellites  and 
satellite  orbits.  One  satellite  may  be  orbiting  the  earth  while  another  satellite  follows 
a  flight  path  from  the  earth  through  the  solar  system.  The  specific  3-D  environment 
addressed  in  my  work  was  the  SIMNET  battlefield.  Air,  land,  and  space  vehicles  are 
present  in  this  3-D  world. 

The  user  of  this  system  needs  to  have  control  of  the  content  of  the  image 
without  requiring  an  understanding  of  the  underlying  computer  data  structures  and 
algorithms.  The  user  is  assumed  to  be  knowledgeable  in  the  field  of  the  image  being 
depicted,  such  as  satellites  and  orbits,  airport  traffic,  or  the  battlefield. 

Interface  Concept  and  User  Controls 

Control  of  the  Omniview  was  divided  into  two  classes,  a  direct  manipulation 
interface  and  an  indirect  manipulation  interface.  The  paradigm  for  the  interface  is  a 
dual-display  work  station.  The  direct  manipulation  interface  (FOLE90)  allows  the  user 
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to  be  viewing  the  Omniview  display  while  controlling  the  image.  The  indirea 
manipulation  intnface  requires  the  user  to  be  viewing  the  host  computer  monitor  while 
controlling  the  image  displayed  and  is  in^lemented  as  a  desktop  user  interface 
featuring  a  pull-down  hierarchical  menu  system.  In  both  cases,  the  user  is  provided 
control  over  the  image  being  displayed. 

The  basic  controls  required  include  positioning  and  sizing  the  view  volume, 
selecting  objects  and  classes  of  objects  to  be  viewed,  and  controls  over  icon  resolution 
and  display  volume  image  update  rate.  The  view  volume  is  the  cylindrical  portion 
(FOLE90)  or  3-D  section  (STYT91)  of  the  3-D  world  or  volume  of  interest  which  is 
to  be  displayed  (Figure  2). 


Figure  2.  View  Volume 


The  position  of  the  view  volume  in  the  volume  of  interest  is  controlled  by 
setting  the  x  and  y  center  of  the  view  volume  or  by  having  an  object  of  interest  kept 
at  a  single  location  in  the  view  volume  (track  mode).  The  object  to  be  tracked 
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remains  at  a  fixed  location  in  the  display  volume  with  all  other  objects  and  the  area 
displayed  moving  relative  to  the  fixed,  tracked  object  V^th  the  view  volume 
positioned  the  user  needed  the  capability  to  size  die  volume. 

The  sizing  of  the  view  volume  is  changed  in  two  directions.  The  radius  of  the 
view  volume  controls  the  x  and  y  dimension  of  die  volume.  The  height  of  the  view 
volume  is  set  independendy.  The  height  is  changed  by  setting  the  maximum  and  die 
minimum  height  values.  Depending  on  the  size  of  the  view  volume  it  is  possible  to 
have  more  objects  in  the  volume  than  the  viewer  can  distinguish. 

Selecting  specific  objects  and  classes  of  objects  to  view  allows  the  user  to 
display  only  the  objects  of  interest.  The  objects  are  organized  in  the  database 
according  to  the  vehicle’s  country  or  operating  environment,  i.e.,  air,  ground,  or 
space.  The  user  can  request  a  listing  of  all  vehicles  or  only  vehicles  from  one 
environment  and  select  a  specific  object  from  the  list.  The  object  can  be  removed 
from  the  image,  or  added  to  the  image  if  it  had  been  previously  removed.  The  user 
can  also  select  a  complete  set  of  objects  (e.g.,  USA  or  USA  air  vehicles).  The 
selected  class  of  objects  can  be  removed  from  the  view,  added  to  the  view,  or  become 
the  only  objects  in  the  view.  The  ability  to  control  whether  an  object  or  class  of 
objects  is  displayed  is  required  to  allow  the  user  to  reduce  the  information  and  detail 
in  the  display. 

The  user  is  given  control  over  the  resolution/complexity  of  icons  used.  The 
image  can  be  drawn  with  objects  depicted  witii  various  icon  complexity.  This  control 
allows  the  user  to  override  the  automatic  resolution  setting  for  the  icons.  Normally, 
more  complex  icons  are  automatically  used  when  the  area  being  displayed  is  smaller. 
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The  user  can  choose  more  complex  icons  if  few  objects  are  being  displayed  If  the 
volume  being  displayed  is  small  and  the  number  of  objects  is  large,  the  user  may  wish 
to  display  the  icon  with  low  resolution. 

The  user  can  set  the  image  update  rate  which  controls  die  length  of  time  each 
image  is  displayed  on  the  Omniview.  This  control  is  used  to  fOTce  the  system  to 
provide  sufficient  time  for  the  user  to  control  the  display.  Otherwise,  the  X  )^dow 
manager  does  not  receive  sufficient  CPU  time  to  respond  to  the  user’s  inputs. 

Tracking  an  object  allows  the  user  to  concentrate  on  a  specific  vehicle.  The 
vehicle  of  interest  may  be  a  missile  or  aircraft  that  would  otherwise  enter  and  exit  the 
view  volume.  Tracking  the  object  keeps  that  item  of  interest  at  a  constant  x  and  y 
location  in  the  view  volume. 

Missile  trajectories  and  histories  (launch  site,  trajectory,  and  impact  site)  are 
requirements  of  the  user.  The  user  requested  the  ability  to  display  a  trajectory  tail 
from  an  active  missile.  This  gives  the  user  a  quick  capability  to  identify  the  missiles, 
the  launch  sites,  and  the  paths  they  have  flown.  In  the  SIMNET  battles  of  interest  this 
is  a  major  benefit  of  the  3-D  display.  These  user  controls  are  provided  with  two  types 
of  interfaces,  indirect  and  direct  manipulation. 

Indirect  Manipulation. 

By  using  the  Sun’s  monitor,  keyboard,  and  mouse;  a  WIMP  GUI  was 
constructed  to  provided  indirect  manipulation  of  the  scene.  Pull-down  menus  and 
point  and  click  dialogues  provide  several  types  of  controls  over  the  image  and  its 
contents.  These  controls  are  designed  to  meet  our  project  goal  of  providing  the  user 
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with  maximum  control  over  the  location  of  die  displayed  volume  and  the  items 
displayed  in  the  volume. 

Direct  Manipulation. 

The  ability  to  position  the  view  volume  in  the  area  of  interest  was 
provided  as  a  basic  user  control.  A  tracking  window  allowed  rapid  large  scale 
movements  to  the  desired  display  area.  Tbe  tracking  area  enables  the  user  to  control 
the  area  depicted  in  the  view  volume  and  the  ability  to  enlarge  or  reduce  the  area 
shown. 

The  movement  of  the  view  volume  was  accomplished  with  a  mouse  tracking 
window  (Figure  3).  This  window  provided  the  user  an  input  area  and  feedback  map 
of  the  area  being  viewed.  The  map  is  a  2-D  representation  of  the  area  of  interest, 
similar  to  a  topographic  or  road  map.  A  circle  on  die  map  depicts  the  location  of  the 
center  of  the  Omniview  display  and  the  area  being  viewed.  Dragging  the  circle  in  the 
window  changes  the  area  being  displayed  on  the  Omniview.  The  user  could  look  at 
the  mt^  to  provide  an  orientation  and  location  of  the  image  in  the  Omniview. 

Direct  manipulation  was  provided  using  a  combination  of  joystick  and  voice 
commands.  A  joystick  is  used  to  control  the  location  and  size  of  the  view  volume 
(Figure  4).  The  location  of  the  view  volume  is  changed  by  moving  the  stick.  The 
size  of  the  view  volume  (radius)  is  changed  by  using  the  butttxi  on  the  joystick; 
moving  the  joystick  fraward  (north)  increases  the  radius  and  moving  the  joystick 
backward  (south)  reduces  the  radius.  Moving  the  joystick  forward  while  pushing  the 
top  button  raises  the  value  being  viewed.  Moving  the  joystick  backward  while 
pushing  the  same  button  lowers  the  value  being  viewed.  Moving  the  joystick 
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Figure  4.  Volume  Being  Displayed  in  Omniview 


forward  while  pushing  the  bottom  button  raises  the  value  being  viewed.  Moving 
the  joystick  backward  while  pushing  the  same  button  lowers  the  value  being 
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viewed.  Appendix  B,  Tables  S  and  6  list  all  joystick  inputs  and  results.  The  change 
in  location  and  size  of  the  volume  being  displayed  was  also  shown  on  the  Sun’s 
tracking  map.  While  the  joystick  is  capable  of  providing  several  control  capabilities, 
other  controls  are  still  needed. 

Voice  control  was  provided  as  an  additional  means  of  direct  conuol  of  the 
Omniview.  Voice  control  enabled  the  user  to  walk  around  the  display,  viewing  it 
from  all  sides  while  maintaining  control  over  the  image.  Simple  voice  commands 
were  used  to  provide  the  basic  inputs  available  from  the  menu  system.  See  Appendix 
B,  Table  7  for  a  list  and  explanation  of  all  voice  commands.  They  gave  direct, 
unambiguous  commands.  Selection  of  individual  items  was  not  provided  using  voice 
control. 

The  dataglove  interface  was  not  developed.  The  Omniview  is  not  an 
immersive  display  technology.  The  user  can  use  a  keyboard,  mouse,  or  joystick  for 
input.  The  difficulties  in  recognizing  dataglove  gestures  and  user  training  time  made 
this  an  inefficient  option  to  pursue  (BRYS92). 

Conclusion 

The  interface  was  designed  to  provide  the  user  the  ability  to  control  and 
manipulate  the  3-D  image  displayed  in  the  Omniview.  The  WIMP  interface  provided 
all  functionality.  The  direct  manipulation  interfaces  (voice  command  and  joystick) 
provided  an  alternate  and  complementary  method  of  controlling  the  display.  A 
summary  of  the  interfaces  implemented  and  the  controls  they  support  appears  in 
Table  2. 


26 


Table  2 


Implemented  Interfaces  and  the  Controls  They  Support 


WIMP 

Joystick 

Voice 

Position  View  Volume 

X 

X 

Scale  View  Volume 

X 

X 

Select  Object 

X 

X 

Renoove  Selected  Object 

X 

X 

Restore  Selected  Object 

X 

Restore  Qass  of  Objects 

X 

X 

Track  Selected  Object 

X 

X 

Toggle  Missile  Tails 

X 

X 

Change  View  Mode 

X 

X 

Any  individual  direct  interface  does  not  provide  all  the  controls  an  indirect 
interface  provides.  The  indirect  interface  is  implemented  using  a  WIMP  GUI.  This 
interface  provides  a  finer  degree  of  control  of  the  display  than  the  direct  interface  but 
at  the  cost  of  the  user  being  placed  three  to  four  feet  from  the  display. 
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IV.  Omniview  Image  Characteristics  of  the  SIMNET  Battlefield 


Introduction 

To  effectively  understand  the  SIMNET  battlefield  image  being  displayed  in  the 
Omniview,  the  viewer  must  be  aware  of  charactoristics  of  the  Omniview  and  trade  offs 
in  the  image  generation.  A  lack  of  understanding  of  icon  sizing,  z  dimension  scaling, 
and  icon  rotation  can  lead  the  viewer  to  misinterpret  the  image  being  presented. 

Those  design  considerations  and  image  characteristics  are  discussed  here. 

Icon  Sizing 

For  our  environments  the  view  volume  is  very  large,  typically  greater  than 
2,500  meters  and  up  to  500,000  meters  in  radius.  The  main  goal  is  to  show  relative 
positioning  and  spacing  of  many  objects,  not  precise  detail  of  any  single  object  The 
overall  status  of  the  area  of  interest  is  important  For  increasingly  large  view  volumes, 
if  accurate  scaling  of  objects  were  maintained,  the  objects  would  very  quickly  be 
scaled  to  the  size  of  a  single  voxel.  As  the  view  volume  increased  the  single  voxel 
would  be  much  larger  than  the  scaled  vehicle.  Representative  vehicles  and  their 
lengths  are  given  in  Table  3.  For  example,  if  the  objects  were  accurately  scaled,  a  10 
meter  long  vehicle  would  require  only  two  voxels  when  the  view  volume  radius  was 
2,000  meters,  and  with  a  view  volume  radius  of  20,000  meters  the  object  is  tme-tenth 
the  size  of  a  voxel  (Table  4). 
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Table  3 


Example  Vehicle  Lengths 


Vehicle 

Length 

(meters) 

F-15 

20 

F-117a 

20 

A- 10 

16 

F-16 

15 

F-111 

23 

Ml 

8 

M60 

7  1 

j  M113 

5  1 

Table  4 

Length  of  Scaled  Object  (in  inches) 
as  a  function  of  View  Volume  Radius  and  Length  of  Object 


Length  of  Object  | 

View  Volume 
Radius  (meters) 

5  m 

7  m 

m 

B 

B 

B 

1,000 

.18 

.25 

.29 

.36 

.54 

.72 

2,000 

.09 

.12 

.14 

.18 

21 

.36 

5,000 

.04 

.05 

.06 

sn 

.11 

.14 

1  10,000 

.02 

.03 

.03 

.04 

.05 

.07 

100,000 

.002 

.003 

.003 

.004 

.005 

.007 

500,000 

.0004 

.0005 

.0006 

.0007 

.0011 

.0014 

Icon  Size  _  Length  of  Object 
36  inches  View  Volume  Radius 
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To  solve  this  problem,  the  image  presented  in  the  display  volume  is  not  an 
accurate  physical  representation  but  a  graphical  representation,  with  objects  much 
larger  than  they  would  appear  if  they  were  accurately  scaled. 

Z  Dimension  Scaling 

To  benefit  from  the  true  3-D  display,  the  image  generated  needs  to  show  a 
change  in  height  (z).  If  the  image  displayed  hail  only  voxels  at  a  single  height, 
constant  z,  the  image  could  be  displayed  with  greater  resolution  on  a  2-D  display.  For 
example,  if  the  radius  of  the  view  volume  was  150,000  meters,  equivalent  scaling  in 
altitude  would  have  the  display  volume  altitude  from  0  to  150,000  meters.  Given  a 
high  flying  aircraft  at  25,000  meters,  the  aircraft  height  in  the  18  inch  high  display 
volume  would  only  be  3  inches.  This  scaling  would  basically  make  the  image  2-D,  in 
the  bottom  of  the  Omniview  display,  and  eliminate  the  benefit  of  the  3-D  display. 
Controlling  the  height  of  the  view  volume  helps  overcome  these  z  scaling  problems. 
The  user  is  provided  three  main  modes  for  setting  the  z  component  of  the  view 
volume;  equal  spacing  in  x,  y,  and  z,  constant  z  scaling,  or  manual  user  control  of  the 
minimum  and  maximum  z  values. 

Equal  spacing  in  x,  y,  and  z  sets  the  minimum  z  value  to  a  predefined  value 
based  on  the  environment  of  interest,  and  sets  the  maximum  z  value  to  the  minimum  z 
value  plus  the  radius  of  the  view  volume.  This  forces  uniform  scaling  in  all  three 
directions.  Equal  spacing  does  present  two  problems.  First,  it  may  position  the  view 
volume  below  many  items  of  interest  This  is  more  likely  to  occur  when  the  radius  is 
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small.  5^cond,  it  may  position  all  items  of  interest  in  the  bottom  of  the  display 
volume,  likely  to  occur  when  the  radius  is  very  large,  100,000  to  500,000  meters. 

Setting  the  view  volume  for  a  constant  defined  maximum  and  minimum  allows 
the  objects  to  be  above  the  bottom  of  the  volume  for  all  radius  settings  of  the  view 
volume.  This  helps  take  advantage  of  the  3-D  capabilities  of  the  display.  The  height 
position  of  an  object  in  the  view  volume  is  independent  of  the  radius. 

The  third  mode  allows  the  user  to  manually  set  the  minimum  and  maximum  z 
values  of  the  view  volume.  If  equal  spacing  was  desired  it  could  be  achieved,  or  if  an 
extremely  narrow  or  wide  altitude  range  was  desired,  that  could  also  be  achieved.  The 
two  modes  with  non-equal  spacing  in  x  and  y  compared  to  z  does  lead  to  difficulties, 
noticeable  when  the  icon  is  rotated  by  the  SBMNET  rotation  matrix. 

Icon  Rotation 

The  placement  and  orientation  of  the  icon  in  the  display  is  dependent  on  the 
view  volume  to  Omniview  display  mapping.  The  world  coordinate  system  is  used  for 
the  view  volume  while  display  coordinates  are  used  for  the  Omniview  display.  User 
control  over  the  mapping  of  world  locations  to  display  locations  is  accomplished  by 
setting  the  center,  height,  and  radius  of  the  view  volume.  The  user  set  center  (x,y)  of 
the  view  volume  is  mapped  to  the  center  of  the  display  volume.  The  user  controls  the 
radius  of  the  view  volume  which  is  mapped  to  the  radius  of  the  display  volume.  The 
radius  of  the  display  volume  is  1,0  (display  coordinates).  The  user  may  also  control 
the  maximum  and  minimum  z  values  of  the  view  volume.  The  maximum  view 
volume  z  value  is  mapped  to  1.0  in  the  display  volume  while  the  minimum  z  value  is 
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mapped  to  0.0  in  the  display  volume.  This  mapping  provides  the  transformatitHi  from 
world  coordinates  to  display  cocmlinates. 

The  world  coordinates  have  equal  and  linear  spacing  in  x,  y,  and  z.  The 
display  comdinates  have  equal  and  linear  spacing  in  x  and  y.  However,  the  spacing  in 
z  can  and  generally  is  different  than  that  of  x  and  y.  That  is,  the  radius  of  the  view 
volume  is  different  than  the  height  of  the  view  volume.  This  can  cause  serious 
perceptual  difficulties  apparent  when  the  pitch  or  roll  are  non-zero.  For  example,  let 
the  object  (vehicle)  be  given  by  the  line  segment  (0,0,0)  to  (0,1,0).  If  the  object  were 
given  in  world  coordinates,  transformed  by  the  SIMNET  rotation  matrix 
(Appendix  A),  then  positioned  using  the  mapping  from  world  coordinates  to  display 
coordinates,  the  resulting  image  would  change  size  depending  on  the  rotation  matrix 
and  the  height  to  radius  ratio  of  the  view  volume.  Figure  5  shows  the  object 
appearing  to  change  size  as  the  pitch  of  the  object  changes.  A  constant  mapping  of 
world  to  display  coordinates  is  used.  The  radius  and  height  of  the  view  volume  are 
not  equal.  The  user  perceives  the  object  to  be  larger  as  the  pitch  increases.  The  user 
may  not  recognize  that  scaling  in  z  is  different  than  scaling  in  x  and  y. 

The  perceived  pitch  of  the  object  would  change  as  the  height  to  radius  ratio  of 
the  view  volume  changes  (Figure  6).  This  figure  shows  an  object  with  a  constant 
pitch  of  45*.  The  height  to  radius  ratio  of  the  view  volume  is  shown  at  1:2,  1:1,  and 
5:1.  The  user  perceives  the  pitch  of  the  object  as  if  the  scaling  in  x,  y,  and  z  were 
equal,  which  is  true  when  the  view  volume  height  and  radius  are  equal.  If  the  object 
appears  to  be  at  a  pitch  of  45*,  assuming  the  scaling  were  equal,  then  the  object  is 
assumed  to  be  at  45*  in  the  world. 
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pitch  s  0  pitch  s  45  pitch  »  90 


Figure  5.  Length  of  Icon  vs  Pitch 


The  difficulty  widi  the  object  rotation  is  partially  overcome  by  rotating  the 
icon,  in  display  coordinates,  then  positioning  the  ic(Mi  in  the  display  volume.  The 
resulting  image  is  not  physically  accurate  but  is  perceived  more  accurately.  This 
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solution  led  to  two  other  difficulties.  The  object  may  t^ypear  to  climb  ot  descend 
much  faster  than  it  actually  does.  The  distance  covered  in  the  display  volume  is 
greater  for  the  change  in  z  than  the  distance  covered  for  the  same  change  in  x  or  y 
because  each  meter  in  the  z  direction  covers  a  greater  view  volume  distance  than  a 
meter  in  the  x  or  y  direction.  When  trajectory  tail  markers  are  dropped  from  a  missile 
the  (mentation  of  the  missile  does  not  appear  to  match  the  trajectory  of  the  displayed 
missile  path.  The  location  of  the  path  voxels  are  ccnrect  in  space  for  the  view  volume 
and  display  volume  but  the  actual  orientation  of  tiie  missile  in  the  view  volume  is  not 
as  portrayed  in  the  display  volume. 

Conclusion 

The  image  displayed  was  generated  to  take  advantage  of  the  3-D  ciqpabilities  of 
the  Omniview.  The  image  is  presented  with  the  object  icons  sized  and  oriented  for 
quick  and  easy  viewer  comprehension  and  not  for  physical  accuracy. 
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V.  Results  and  Conclusions 


Introduction 

The  Omniview  display  provides  a  unique  way  of  viewing  the  3-D  world. 

Several  viewers  were  able,  simultaneously,  to  see  the  image  from  their  perspective. 
This  group  viewing  aided  in  the  understanding  and  discussion  of  the  image.  This 
chapter  discusses  our  experience  with  the  Omniview  and  each  of  the  interfaces 
developed.  Because  general  experience  with  the  Omniview  is  extremely  limited,  we 
also  discuss  our  experience  with  this  new  3-D  display. 

Omniview  Experience 

The  voxel  size,  budget,  and  scheduler  caused  unexpected  results.  As  more 
voxels  were  requested  to  be  illuminated  the  scheduler  had  great  difficulty  in  generating 
the  desired  image.  For  example,  flat  grids  started  having  peaks,  valleys,  ridges  and 
dropouts.  The  resulting  image  changed  as  the  wder  of  requested  points  changed.  A 
line  of  voxels  that  should  have  been  in  a  straight  line  could  look  very  ragged  and 
disjointed,  depending  on  the  number  of  voxels  requested. 

The  Sun  4/470  lacked  the  CPU  power  to  simultaneously  perform  all  the 
desired  functions  and  generate  displays  at  the  highest  rate  displayable  by  the 
Omniview.  The  machine  can  generate  simple  images  with  no  user  interaction  at  10 
frames/sec.  However,  trying  to  generate  complex  images,  approximately  7,000  voxels, 
at  10  frames/sec  and  support  a  responsive  user  interface  proved  difficult  Slowing  the 
display  to  1-2  frames/sec  allowed  satisfactory  response  to  usct  input  As  the  size  of 
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the  area  being  viewed  increased  the  slower  frame  rate  became  less  and  less  noticeable 
because  the  distance  the  objects  moved  per  frame  was  smallo'.  This  information  was 
gathered  during  my  work  with  the  Omniview.  TI,  the  only  previous  user  of  the 
device,  did  not  provide  a  time/cost  estimate  for  generating  each  frame. 

The  lack  of  CPU  power  was  apparent  when  processing  SIMNET  PDUs. 
Processing  all  PDUs  was  not  possible.  When  network  traffic  was  above  125  PDUs/sec 
the  routine  which  read  and  processed  PDUs  until  no  PDUs  were  waiting  to  be 
processed  was  unable  to  complete.  There  were  always  PDUs  waiting  to  be  processed. 
The  arrival  rate  of  the  PDUs  is  greater  than  the  processing  rate. 

A  partial  solution  was  to  ignore  PDUs  and  process  only  a  set  number  of  PDUs. 
Most  PDUs  are  position  updates,  and  the  display  frame  rate  is  set  by  the  user,  so 
many  of  the  lost  PDUs  do  not  affect  the  image.  The  user  was  allowed  to  set  the  rate 
at  which  PDUs  are  processed. 

3-D  Interactive  Interface  Experieru:e 
Indirect  Manipulation. 

The  Sun’s  WIMP  interface  provided  complete  control  of  the  generated 
image.  Individual  objects  and  classes  of  objects  could  be  removed  frrom  the  scene. 
The  selection  of  objects  and  classes  of  objects  was  provided  by  pull-down  menus  and 
point  and  click  item  selection  boxes.  This  greatly  aided  the  viewers  in  identifying  and 
locating  specific  items  of  interest.  Removing  unwanted  objects  from  the  display 
reduced  the  information  presented  and  allowed  the  user  to  see  the  information  of 
importance.  Rapid,  large  scale  movement  across  the  environment  could  also  be  made. 
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Feedback  to  the  user  was  provided  on  the  window  of  the  Sun  and  in  the  Omniview. 
The  window  interface  allowed  settings  that  aided  in  testing  and  supporting  the  direct 
manipulation  interface. 

Direct  Manipulation. 

The  direct  manipulation  methods  provided  a  useful  alternative  to  the 
indirect  manipulation  interface.  The  joystick  proved  useful  in  controlling  the  location 
and  size  of  the  area  being  displayed.  Positioning  with  the  stick  was  intuitive  with 
sufficient  precision  for  the  resolution  of  the  display.  The  ability  to  select  an  object  in 
order  to  provide  information  on  it  was  very  usehil.  This  allowed  the  user  to 
completely  identify  any  object  This  was  particularly  important  because  the  3-D 
display  did  not  provide  sufficient  resolution  for  positive  identification. 

Voice  control  allowed  the  user  to  change  the  items  in  the  display  while 
viewing  the  display  from  any  location.  Viewing  the  image  as  it  changed  aided  in 
quickly  identifying  differences  in  the  images.  A  drawback  to  voice  control  is  the 
voice  system  must  be  trained  to  recognize  each  user.  Some  users  were  able  to  use  a 
voice  trained  by  some  other  user  and  achieve  reasonable  command  acceptance. 
GeneraUy,  however,  each  user  had  to  train  the  voice  system  for  all  commands. 

Future  Research 

Several  extensions  to  the  direct  image  manipulation  methods  can  be  made.  The 
joystick  control  should  be  expanded  to  include  position  and  orientation  tracking  of  the 
joystick.  This  would  enable  the  user  to  walk  around  the  display  and  not  be  concerned 
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with  the  arientadoii  of  the  stick.  Pushing  the  stick  toward  the  center  of  the  display 
would  always  have  the  same  effect. 

A  3-D  joystick  or  spaceball  could  easily  be  added.  The  3-D  joystick  would 
allow  the  user  to  change  the  location  of  the  viewing  cylinder  in  all  three  directions  and 
change  the  size  of  the  volume  separately  in  radius  and  in  height.  Tracking  the  joystick 
would  require  positioning  and  orientation  to  be  provided  by  a  tracker  such  as  a 
Polhemus.  The  spaceball  would  give  similar  capabilities.  These  devices  may  provide 
more  intuitive  interfaces  than  the  2-D  joystick. 

The  replacement  of  the  joystick  selector  with  a  pointing  device,  similar  to  a 
laser  pointer,  should  be  considered.  The  pointer  would  allow  the  user  to  point  at  an 
object  to  have  a  specific  acdon  take  place,  such  as  removing  the  object  from  the  view, 
idendfying  the  object,  or  changing  the  object’s  attributes.  This  would  require  tracking 
the  posidon  and  orientadon  of  the  poindng  device.  Projecting  a  beam  through  the 
display  would  also  be  requited. 

Conclusion 

The  interacdve  user  control  of  the  Omniview  allowed  muldply  viewers  to 
observe  a  SIMNET  batde  in  progress.  The  paradigm  of  controlling  a  cylindrical  view 
volume  posidoned  in  the  area  of  interest,  sized  by  changing  the  radius,  top,  and 
bottom  of  the  cylinder  was  an  effecdve  approach  and  model  for  allowing  the  user  to 
control  the  image  displayed.  Treating  the  3-D  display  and  host  computer  as  a  two 
display  woikstadon  allowed  the  user  to  understand  and  benefit  from  the  different 
interfaces  and  gain  the  maximum  benefit  from  the  3-D  TI  Omniview. 
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Appendix  A 

SIMNET  Rotation  Matrix 


The  SIMNET  rotation  matrix  is  based  on  tlw  heading,  pitch,  and  roll  of  the  vehicle. 
Let: 

SH  =  sin  (Heading),  CH  =  cos  (Heading) 

SP  =  sin  ^tch),  CP  =  cos  (Pitch) 

SR  =  sin  (Roll),  CR  =  cos  (Roll) 


Then  the  9-element  SIMNET  Rotation  Matrix  (M)  is: 


M  = 


CH*CR  +  SH*SP*SR  SH*CR  -  CH*SP*SR 
SH*CP  CH*CP 

CH*SR  -  SH*SP*CR  -SH*SP  -  CH*SP*CR 


-CP*SR 

SP 

CP*CR 


Let  Heading  »  0* 

Pitch  =  45* 

RoU  =  0* 

Then  the  rotation  matrix  is: 


M  = 


1  0  0 
0  0.707  0.707 
0  -0.707  0.707 
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Appendix  B 

SIMNET  Battlefield  Viewer  User's  Manual 


Introduction 

The  SIMNET  battlefield  viewing  program  (simbatview)  is  a  window,  icon, 
mouse,  and  pointer  (WIMP)  grs^hical  user  interface  (GUI)  ctmtrolled,  interactive 
program  to  view  a  SIMNET  battle  on  a  true  3-D  display,  the  TI  Omniview™.  The 
display  can  also  be  controlled  through  joystick  or  voice  commands:  however,  neither  a 
joystick  nor  voice  support  are  required  as  all  functions  are  provided  through  the 
WIMP  GUI.  This  manual  covers  the  startup  of  the  simbatview  program,  the  usor 
controls,  menus,  windows,  commands,  and  the  basic  ctmfiguration  of  the  program. 

Startup 

There  are  two  basic  versions  of  the  simbatview  program.  These  versions  differ 
by  the  source  of  the  SIMNET  PDUs.  One  executable  program,  simbatviewdemo,  uses 
canned  demonstration  files  as  the  source  of  the  PDUs.  This  program  runs  without 
network  support  and  can  be  used  when  no  SIMNET  exercises  are  in  progress.  The 
other  executable  program,  simbatviewnet  uses  the  network  as  the  source  for  the 
SIMNET  PDUs.  An  exercise  or  exercise  replay  must  be  in  progress  to  provide 
vehicles  to  observe.  The  netwoik  support  requires  simbatviewnet  to  be  run  frtnn  the 
root  account 

A  Macintosh  Ed  with  Voice  Navigator  System  is  used  to  provide  voice 
recognition.  The  software  is  located  in  the  Applications  folder  untkr  vista,  program 
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vista.  See  the  section  covering  configuration  for  correct  connection  of  the  Macintosh 
Voice  Navigator  to  the  Vista  Sun. 

Operation 

Several  types  of  controls  over  the  Omniview  image  and  its  contents  are 
provided.  These  controls  include  positioning  and  sizing  the  view  volume,  selecting 
speciHc  objects  to  view,  selecting  classes  of  objects  to  view,  selecting  a  specific  object 
to  track,  setting  the  image  update  rate,  and  altering  the  resolution/complexity  of  die 
icons  used. 

Two  different  classes  of  interfaces  to  the  Omniview  were  implemented  to 
provide  these  controls.  The  direct  interface  allows  you  to  be  in  front  of  the  Omniview 
and  control  the  display.  The  indirect  interface  is  in^lemented  using  a  WIMP  GUI  on 
the  Sun.  This  interface  provides  a  finer  degree  of  control  of  the  display  than  the 
direct  interface  but  requires  you  to  be  at  a  distance  (3-4ft)  from  the  Omniview  display. 
You  are  unable  to  observe  the  image  on  the  Omniview  as  you  are  controlling  it  with 
the  WIMP  system. 

Indirect  manipulation  controls  are  provided  through  a  WIMP  GUI  running  on 
the  Sun  host  computer.  The  GUI  is  implemented  using  four  windows  (Figure  7). 

Two  of  the  windows  are  used  for  controlling  the  image  while  the  other  two  windows 
provide  status  of  the  system,  display,  and  information  on  a  selected  or  tracked  object. 

Omniview  Tractor  Window.  Controls  to  position  and  size  the  view  volume  are 
provided  using  the  Omniview  Tracker  window  (Hgure  8).  This  window  displays  a 
2-D  map  of  the  world  of  interest  A  circle  on  the  map  shows  the  area  of  the  world 
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Figure  7.  GUI  Windows 


included  in  the  view  volume.  A  menu  bar  at  the  top  of  the  window  allows  you  to 
choose  Application,  Z-Scaling,  or  Information. 

The  X,  Y,  and  Radius  blocks  at  the  bottom  left  of  the  window  show  the  x-  and 
y-coordinates  of  the  center  of  the  view  voluiiK,  and  the  radius  shows  the  view  volume 
radius.  The  blocks  at  the  bottom  right  of  the  window  show  the  maximum  and 
minimum  altitude  values  for  the  displayed  view  volume.  The  x-  and  y-cooidinates  are 
measiu-ed  from  an  exercise  defined  origin.  All  values  are  in  meters  with  the  altitude 
values,  and  measured  from  sea  level. 

When  the  pointer  is  moved  into  the  map  area,  the  left  noouse  button  is  used  for 
setting  the  x  and  y  location  of  the  view  volume.  The  middle  mouse  button  controls 
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Figure  8.  Omniview  Tracker  Window 


the  size  of  the  radius.  The  buttons  can  be  us^  by  clicking  directly  at  the  location  of 
interest  or  by  holding  the  button  down  and  dragging  the  center  or  radius  to  that 
location. 

Z-scaling  provides  the  basic  methods  fOT  setting  the  maximum  z  value  of  the 
view  volume.  The  maximum  value  can  be  set  to  the  exercise  defined  maximum 
altitude  of  interest  (normally  S0,(XX)  meters)  or  it  can  be  set  to  the  minimum  altitude 
of  interest  plus  the  radius  of  the  view  volume.  Dynamic  noode  uses  the  defined 
maximum  altitude  of  interest  until  the  radius  is  less  than  the  difference  in  the 
maximum  and  minimum  altitudes  of  interest  at  which  time  Zg„  is  the  exercise  defined 
minimum  plus  the  view  volume  radius. 
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Omniview  Display  Controls  Window.  The  Omniview  Display  Controls  window 
includes  a  menu  bar  where  Application,  View  Mode,  Objects  to  View,  Misc  Control, 
Terrain  Mode,  or  Reset  can  be  selected  (Figure  9).  Under  Application  are  Open, 
Iconify,  and  (^t.  Open  restores  all  iconified  windows.  Iconify  reduces  all  windows 
to  icons.  Quit  stops  the  application,  after  confirmation. 


Omniview  EHsplay  Controls 


□ 


Application  View  Mode  Objects  to  View  Misc  Control  Terrain  Mode  Reset 


Figure  9.  Omniview  Display  Controls  Window 


Under  View  Mode  are  Fixed  View  for  Display,  Track  Object  from  all.  Select 
Object  to  Track,  Autotrack  with  lock.  Autotrack  newest.  Missile  History  and  Track 
Selected  (Figure  10).  When  Fixed  View  for  Display  is  selected,  the  sub- volume  being 
displayed  will  not  change.  Objects  will  move  in  and  out  of  the  displayed  volume. 
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' — '  Ommview  Display  Controls 

□ 

Application 

/iew  Mode  Objects  to  View  Miac  Control  Tcnain  Mode  Reaet 

Hxed  View  for  Di^lay 
Track  Obiect  from  aU 

1  Sdect  Obiect  to  IVack  ^1 

Ollier  Countries^ 

Autotrack  with  lock 
Autotrack  newest 

Missile  History 

Track  Selected 

USSR  > 

Russia  > 

Germany  > 

Iraq  > 

mSm 

Air 

Grounds 
Space  > 
Water  > 

Figure  10.  View  Mode  Menu 


When  Track  Object  fix)in  all  is  selected,  a  list  of  all  vehicles  will  be  displayed.  The 
object  to  track  can  then  be  selected  from  the  list.  Select  Object  to  Track  divides  the 
objects  into  a  tree  structure  with  country  as  the  first  subdivision.  The  coimtries  may 
be  subdivided  into  environment.  By  using  the  sub-menus,  a  speciHc  item  to  track  can 
be  selected  much  quicker  than  through  the  Track  Object  from  all  option.  When  the 
joystick  is  enabled  and  in  selector  mode.  Track  Selected  will  cause  the  selected  object 
to  become  the  tracked  object 

Objects  to  View  allows  toggling  objects  on  and  off  (Figure  11).  Individual 
objects  or  complete  classes  of  object  (i.e.,  USA  or  USA  Air)  can  be  toggled  on  and 
off.  Classes  of  objects  can  also  be  restored  to  the  view,  removed  from  the  view,  or 
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1 - 1 

Omniview  Display  Controls 

a 

1  1 

Application  View  Mode 

Objects  to  View 

Misc  Control  Torain  Mode  Reset 

Other  Countries  > 


1  USA 

0 

display  aU 

USSR 

> 

displi^none 

Russia 

display  only 

Gennany 

> 

Othn  > 

Iraq 

> 

Air  > 

Remove  Selected 

1  Ground  >| 

Water 


display  aU 
display  none 
display  only 
By  ID  cntenv  nofam 


Figure  11.  Objects  to  View  Menu 


made  the  only  items  to  be  displayed  When  the  joystick  is  enabled  and  in  selector 
mode,  Remove  Selected  removes  the  selected  object  from  the  view. 

Misc  Control  includes  Icon  Control,  Image  and  Tracker  Image  Delay,  PDU 
Process  Interval,  Axis  Control,  Joystick,  TrajecUnry  Tails,  and  Voice  (Figure  12).  Icon 
Control  allows  you  to  select  between  high,  medium,  and  low  resolution  for  the  icons. 
Image  and  Track  Image  Delay  allow  you  to  select  the  amount  of  time  between  updates 
of  the  image  in  the  Omniview  and  Tracker  Window,  respectfully.  SIMNET  PDUs  are 
processed  independent  of  the  image  updates.  PDU  Process  Interval  allows  you  to  set 
the  time  between  processing  PDUs.  This  setting  controls  the  amoimt  of  time  used  for 
reading  and  processing  PDUs.  The  user  can  guarantee  sufficient  CPU  time  is 
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Ommview  Display  Controls  “  D 

Application  View  Mode  Objects  to  View 

Miac  Control  Tecrain  Mode  Reset 

Ion  Control  > 

Image  Deli^  > 

nXJ  Process  Interval  > 
Axis  Control  > 

Tradter  Image  Del^  > 
Joystick  > 

Trajectory  Tails  > 

Voice  > 

Figure  12.  Miscellaneous  Controls  Menu 


available  for  image  generating  and  user  inputs.  By  increasing  the  value  of  PDU 
Process  Interval.  Axis  Control  governs  if  a  North,  East,  Up  axis  is  displayed  in  the 
volume,  and  where  in  the  volume  the  axis  is  placed. 

Terrain  Mode  is  used  to  vary  the  density  with  which  the  grid  representing  the 
terrain  is  displayed  (Figure  13).  The  terrain  is  currently  a  flat  grid  as  the  area  of 
interest  for  this  exercise  is  very  close  to  flat  for  any  area  displayed  in  the  Qmniview. 
The  approximate  spacing  between  terrain  grid  points  is  shown  in  the  Status  Window. 

Status  Window.  This  window  provides  a  single  point  to  find  the  settings,  status 
and  performance  of  the  system  (Figure  14).  The  view  mode  is  set  frcnn  the  Display 
Control  window  or  by  voice  command.  Tracking  ID  specifies  the  vehicle  being 
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1 — 1 

Omniview  Display  Oxitrols 

O 

1  1 

Application  View  Mode  Objects  to  View  Misc  Control 

Tenain  Mode 

Reset 

tcnain  off 
terrain  low  res 
terrain  med  res 
terrain  higb  res 
terrain  dynamic  res 

1 

Figure  13.  Terrain  Mode  Menu 

tracked,  if  view  mode  is  one  of  the  tracking  options.  If  the  tracked  vehicle  is  found, 
its  X,  y,  and  z  location  is  given.  Terrain  Resolution  and  Spacing  gives  the  noode  of  the 
terrain  and  the  approximate  spacing  between  terrain  grid  points. 

Frame  rate  is  the  average  number  of  frames  displayed  in  the  Omniview  per  unit 
time  and  will  be  in  frames  per  minute  or  frames  per  second.  Number  of  objects  is  the 
count  of  known  active  vehicles  in  this  SIMNET  exercise.  Point  count  is  the  number 
of  voxels  requested  to  be  illuminated  in  the  display  volume  for  all  items  including 
vehicles,  axis,  and  selector.  This  value  currently  does  not  include  the  numbo-  of 
voxels  requested  to  display  the  terrain.  FDU/sec  and  Rrocess/sec  give  the  average 
number  of  PDUs  received  and  the  average  number  of  vehicle  appearance  PDUs 
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Status  Window 


Vmw  Mode:  [ 
TfKkID:  [ 

X:[ 

Y:[ 

Z:[ 

loon  RefotaiaB;  [ 
Temin  Rei/SpaeiBf:  [ 
Tncker  Update  Rate;  [ 
Imate  Upd«e  Ratt:  [ 
PDU  Uptbte  Rate:  [ 
Joyaticfc:  [ 
Voice:  [ 
Tiajectoiy  Tad:  [ 
Fnme  Rate:  [ 
Number  Oltiectt:  [ 
Point  Count:  [ 
PDU/tec  prooeu/MC  [ 


Figure  14.  Status  Window 


processed.  Other  PDU  types  are  currently  ignored.  All  other  values  are  simply  the 
current  settings  for  the  named  parameters.  The  status  window  reflects  inputs  from  the 
direct  manipulation  interfaces,  the  joystick,  and  voice  ccnnmands. 

Item  Information  Window.  This  window  provides  detailed  information  on  a 
selected  or  tracked  vehicle  (Figure  IS).  The  vehicle  described  is  selected  by  the 
joystick  selector.  The  selection  of  the  vehicle  is  based  on  the  noode  of  the  selector.  If 
the  joystick  is  not  enabled  or  not  in  selector  mode,  and  a  vehicle  is  being  tracked,  the 
information  on  the  tracked  vehicle  will  be  displayed.  The  values  shown  are  taken 
from  the  SIMNET  PDU.  For  example,  die  guise  field  is  a  32  bit  hex  value.  If  no 
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ItemWindow  Info 


Object  Mode: 
Vehicle  ID  Qocai): 

X: 

Y: 

Z: 

Velocity  X: 
Velocity  Y: 
Velocity  Z: 


CoanBy:  [ 
EnvifconieBt:  [ 
Model:  [ 
Site:  [ 
Hoet:  [ 
Eality:  [ 
Oniie:  [ 


Figure  15.  Item  Infonnation  Window 


item  is  being  tracked  and  the  joystick  is  not  in  selector  mode,  the  item  infonnation 
window  is  empty. 

Joystick.  The  joystick  can  be  used  to  position  and  size  the  volume 
(positioning  and  sizing  mode)  or  to  select  an  item  of  interest  (selector  mode).  The 
joystick  is  enabled  and  disabled  using  the  WIMP  GUI.  The  inputs  fiom  the  joystick 
are  interpreted  differently  based  on  the  mode  which  can  be  changed  by  using  the 
WIMP  GUI  or  voice  commands.  Joystick  button  placement  and  numbering  is  shown 
(Figure  16). 

Positioning  and  Sizing  Mode.  The  joystick  is  used  to  change  the 
X  and  y  location  of  the  view  volume  and  combinations  of  the  joystick  and  buttons  are 
used  to  change  the  size  of  the  view  volume  (Table  5). 
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Selector  Mode.  The  object  is  selected  by  choosing  the  closest 
object  to  the  3-D  cross  hair  selector.  The  closest  object  is  selected  in  one  of  two 
methods;  either,  distance  from  selector  to  the  object  based  (hi  (h*  the  distance 

from  the  selecttn*  to  the  object  based  on  x^  +  y^  +  z*.  Actions  resulting  from  joystick 
inputs  when  in  selecttn*  mode  are  shown  in  Table  6. 

Voice  Command  Interface.  Voice  crommands  are  used  when  viewing 
the  Onmiview  display  (Table  7).  Many  commands  w(Hk  in  conjunction  with  the 
joystick.  All  functionality  provided  with  voice  ctnnmands  is  available  through  the  host 
computer  WIMP  GUI.  Voice  must  be  enabled  and  disabled  through  die  WIMP  GUI. 
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Tables 


Joystick  Positioning  and  Sizing  Mode 


Stick 

Button 

Button 

Button 

View  Volume  Movement 

Movement 

1 

2 

3 

Forward 

0 

0 

0 

North  (+y) 

Back 

0 

0 

0 

South  (-y) 

Right 

0 

0 

East  (+x) 

Left 

0 

0 

0 

West  (-X) 

Forward 

1 

0 

0 

Increase  radius 

Back 

1 

0 

0 

Decrease  radius 

Forward 

0 

1 

0 

Increase  (raise) 

Back 

0 

1 

0 

Decrease  (lower) 

Forward 

0 

0 

1 

Increase  (raise) 

Back 

0 

0 

1 

Decrease  (lower)  z^ 

(all  other  button  combinations  are  not  used,  ignored) 
0  =  button  not  pressed 
1  =  button  pressed 
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Table  6 


Joystick  Selector  Mode 


Stick 

Button 

Button 

Button 

Selector  Movement 

Movement 

1 

2 

3 

Forward 

0 

0 

0 

Moves  selector  North 

Back 

0 

0 

0 

Moves  selector  South 

Right 

0 

0 

0 

Moves  selector  East 

Left 

0 

0 

0 

Moves  selector  West 

Forward 

1 

0 

0 

Increase  speed  selector  nooves 

Back 

1 

0 

0 

Decrease  speed  selector  moves 

Forward 

0 

1 

0 

Moves  selector  up 

Forward 

0 

0 

1 

Increases  altitude,  z 

Back 

0 

1 

0 

Moves  selector  down 

Back 

0 

0 

1 

Decreases  altitude,  z 

0 

1 

1 

Toggle  between  point  and  line 

selector 

(all  other  button  combinations  are  not  used,  input  ignored) 
0  =  button  not  pressed 
1  =  button  pressed 


Table? 


Voice  Commands 


Command 

Action 

Fixed 

Set  view  mode  to  fixed 

Track 

Newest 

Set  view  mode  to  track  newest 

Lock 

Set  view  mode  to  lock  on  next  missile 

1  Object 

Track  the  selected  object 

1  Remove 

y  Foes 

Remove  all  red  forces  from  display 

Friends 

Remove  all  blue  forces  from  display 

Object 

Remove  the  selected  object 

Restore 

All 

Display  all  objects 

Foes 

Add  all  red  forces  to  display 

Friends 

Add  all  blue  forces  to  display 

Selector 

Enable 

Joystick  in  selector  mode 

Disable 

Joystick  in  position/size  mode 

Rubberband 

Joystick  selector  with  connecting  line 
from  selector  to  selected  object 

Irail 

Toggle  missile  trajectory  tails 
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Cor^guration  and  Setup 

Setup.  The  simbatviewdemo,  simbatviewnet,  iconJst  and  the  PDU 

demonstration  script  files  are  all  located  in  the  same  directory.  The  joystick  is 

connected  to  /dev/ttya  and  the  Macintosh,  providing  voice  support,  is  connected  to 

/dev/ttyb.  The  programs  do  not  required  the  joystick  or  Macintosh  to  be  connected. 

Icons.  The  list  of  available  icons  is  maintained  in  the  file  icon.lst  Each  line 

in  the  file  contains  the  information  on  one  vehicle  including; 

SIMNET  guise,  description,  file  location  and  name,  scaling  factor,  color  nKxlification 

flag,  and  the  color  (red,  green,  and  blue)  intensity.  An  exanq>le  entry  is: 

0x248040  A-10  .yicons/A-lO.Icon  0.004  1  0  1  0 

After  scaling  by  size,  the  icon  is  to  be  the  correct  size  for  display  in  the  Onmiview. 

New  icons  can  be  added  without  modifying  or  rebuilding  the  simbatview  executables. 

Building  Executables.  If  the  executables  need  to  be  built  the  appropriate 

command  is  "make  -f  gnumakefile."  The  executable  generated  is  "menuDemo."  This 

rile  should  be  moved  to  ~vista/simbatview/simbatview —  (net  or  demo). 

(The  makefile  should  be  modified  to  automatically  build  both  versions,  place  the 

executables  in  the  correct  directories,  and  support  the  commands: 

make  -f  gnumakefile  all 

make  -f  gnumakefile  simbatviewdemo 

make  -f  gnumakefile  simbatviewnet) 

The  make  files  are  located  in  the  same  directory  as  the  source  code  (./source/omni). 
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Appendix  C 

VISTA  Security  Procedures 

Introduction 

The  VISTA  system  will  only  be  operated  in  classified  nxxk  for  pitx«ssing  of 
SIMNET  Warbreaker/Zealous  Pursuit  Exercises.  No  other  classified  processing  is 
covered  by  these  directions. 

The  Macintosh  Ilci  will  only  be  used  if  voice  commands  are  being  used  to 
control  the  VISTA.  Otherwise,  if  the  VISTA  is  in  classified  mode  the  Macintosh  will 
be  powered  down. 

Classified  System  Startup 

1.  Log  classified  system  startup  in  the  Qassified  Computer  Usage  Log,  VISTA. 

2.  Shutdown  the  Sun  (if  currently  running  and  powered  up)  and  wait  for  the  ">" 
prompt. 

3.  Verify  the  two  external  disk  drives  (marked  secret)  are  powered  down. 

4.  Verify  the  external  drive  chassis  is  powered  down. 

5.  Disconnect  the  Sun/VISTA  system  from  the  network  (classified  and  unclassified). 

6.  Connect  the  Sun/VISTA  system  to  the  classified  network. 

7.  Power  up  the  two  external  drives  (marked  secret). 

8.  Boot  the  Sun  by  typing: 

b  sd(0,8,0)vmunix 


9.  Startup  the  Macintosh  only  if  voice  cwnmand  suppcxt  will  be  used.  (See 
Macintosh  Dei  below.) 

Classified  System  Shutdown 

1.  Shutdown  the  Sun  be  issuing  the  unix  command  (from  the  root  account): 

/etc/shutdown  -h  now 

2.  Verify  the  Sun  is  halted  (wait  for  the  ">”  prompt). 

3.  Power  down  the  two  external  disk  drives  (marked  secret). 

4.  Disconnect  the  Sun  from  the  classified  netwOTk. 

5.  Log  classified  system  shutdown  in  the  Classified  Computer  Usage  Log,  VISTA. 
Unclassified  System  Startup 

To  change  from  classified  to  unclassified  q>eration  the  system  must  first  be 
shutdown  using  the  Classified  System  Shutdown  procedures,  and  only  then  can  the 
system  be  started  in  the  unclassified  mode. 

1.  Log  the  unclassified  system  startup  in  the  Qassified  (^omputo’  Usage  Log,  VISTA. 

2.  Shutdown  the  Sun  (if  currently  running  and  powered  up)  and  wait  for  the  ">" 
prompt. 

3.  Verify  the  two  external  disk  drives  (marked  secret)  are  powered  down. 

4.  Verify  the  external  drive  chassis  is  powered  down. 

5.  Disconnect  the  SunA^ISTA  system  from  the  network  (classified  and  unclassified). 

6.  Connect  the  Sun/VISTA  system  to  the  unclassified  network. 

7.  Power  up  the  external  drive  chassis. 

8.  Verify  the  two  external  disk  drives  (marited  secret)  are  powered  down. 
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9.  Power  up  the  Sun. 

10.  Boot  the  Sun.  The  default  drive  will  be  used.  Type  the  ctnninand: 

b 

11.  Power  up  the  Macintosh  if  voice  command  support  will  be  used.  (See  Macintosh 
nci  below.) 

Unclassified  System  Shutdown 

1.  Shutdown  the  Sun  be  issuing  the  unix  command  (from  the  root  account): 

/etc/shutdown  -h  now 

2.  Verify  the  Sun  is  halted  (wait  for  the  ">"  prompt). 

3.  Power  down  the  external  disk  drive  chassis. 

4.  Disconnect  the  Sun  from  the  network. 

5.  Log  unclassified  system  shutdown  in  the  Classified  Computer  Usage  Log,  VISTA. 
Disk  Drive  Corfiguration 

The  VISTA  Sun  currently  supports  four  disk  drives.  Two  drives  are  only  used 
for  classified  processing  and  two  drives  are  used  tmly  for  unclassified  processing. 

Classified  Drives.  These  drives  are  external  SCSI  disks  located  on  top  of  the 
Sun  cpu  chassis.  Both  drives  are  marked  secret 
sd2  classified  system  disk 

sd4  H  demos  for  use  during  classified  operation  (Note;  These  demos  are 
not  classified.) 
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Unclassified  Drives. 

sdO  unclassified  system  disk 

idOOO  TI  denx)S  for  use  during  unclassified  operation 

Macintosh  Ilci 

The  Macintosh  Ilci  connected  to  the  VISTA  will  not  be  used  for  the  processing 
of  classified  information.  The  only  purpose  for  the  Macintosh  is  to  provide  voice 
command  interface  to  the  VISTA.  If  the  VISTA  is  operating  classified,  the  Macintosh 
will  only  be  used  for  Voice  Command  support.  If  voice  commands  will  not  be  used 
while  the  VISTA  is  operating  in  classified  mode,  the  Macintosh  will  be  shutdown  and 
powered  off.  The  Macintosh  may  be  used  when  the  VISTA  is  in  unclassified  mode. 
The  Macintosh  does  not  receive  information  from  the  VISTA  in  either  mode  of 
operation. 

1.  Voice  navigator  must  be  powered  up  before  the  Macintosh. 

a.  AC/DC  power  adapter  plugged  in. 

b.  Red  power  switch  on  side  of  navigator. 

2.  Power  on  the  Macintosh. 

3.  Connection  between  the  Macintosh  and  Sun  is  via  a  one  way  cable.  The 
Macintosh  can  transmit  to  the  Sun.  The  Sun  cannot  transmit  to  the  Macintosh.  (The 
connection  is  with  a  customized  RS232  connection.  Only  pins  2  (transmit)  and  7 
(ground)  on  the  Macintosh  are  connected.  Only  pins  3  (receive)  and  7  (ground)  are 
connected  on  the  Sun.) 


59 


Bibliography 


BEAT87.  Beaton,  Robert  J.  et  al.  "An  Evaluation  of  Input  Devices  for  3-D 

Computer  Display  Workstations,"  SPIE  True  3-D  Imaging  Techniques 
and  Display  Technologies,  761:  94-191  (1987). 

BEAT88.  Beaton,  Robert  J.  and  Novia  Weiman.  "User  Evaluation  of  Cursor- 
Positioning  Devices  for  3-D  Display  Workstations,"  SPIE  Three- 
Dimensional  Imaging  and  Remote  Sensing  Imaging,  902:  53-58  (1988). 

BENT82.  Benton,  Stephen  A.  "Survey  of  Holographic  Stereograms,"  SPIE 

Processing  and  Display  of  Three-Dimensional  Data,  367:  15-19  (1982). 

BRYS92.  Bryson,  Steve.  "Survey  of  Virtual  Environment  Technologies  and 
Techniques,"  Implementation  of  Immersive  Virtual  Environments. 
1.1-1.35  ACM  (July  1992). 

BUDI84.  Budinger,  Thomas  F.  "An  Analysis  of  3-D  Display  Strategies,"  SPIE 
Processing  and  Display  of  Three-Dimensional  Data  II,  507:  2-8  (1984). 

BUXT83.  Buxton,  William.  "Lexical  and  Pragmatic  Considerations  of  Input 
Structures,"  ACM  Computer  Graphics  17(1):  31-37  (January  1983). 

CHEN88.  Chen,  Michael  et  al.  "A  Study  in  Interactive  3-D  Rotation  Using  2-D 
Control  Devices,"  ACM  Computer  Graphics  22(4):  121-129  (August 
1988). 

FELG92.  Felger,  Wolfgang.  "How  Inter^tive  Visualization  can  benefit  from 
Multidimensional  Input  Devices,”  SPIE  Visual  Data  Interpretation, 
1668:  15-24  (1992). 

FOLE90.  Foley,  James  et  al.  Computer  Graphics,  Principles  and  Practices  (2nd 
ed).  New  York:  Addison-Wesley  Publishing,  1990. 

FUCH82.  Fuchs,  Henry  et  al.  "Adding  a  True  3-D  Display  to  a  Raster  Graphics 
System,"  IEEE  Computer  Graphics  and  Applications,  2:  73-78 
(September  1982). 

FUCH89.  Fuchs,  Henry  et  al.  "Interactive  Visualization  of  3-D  Medical  Data," 
IEEE  Computer,  22:  46-51  (August  1989). 

HARR88.  Harris,  Lowell  D.  "A  Varifocal  Mirror  Display  Integrated  into  a  High- 
Speed  Image  Processor,"  SPIE  Three-Dimensional  Imaging  and  Remote 
Sensing  Imaging,  902:  2-9  (1988). 


60 


HODG87.  Hodges,  Larry  F.  and  David  F.  KfcAllister.  "Hiree-DimensirMial  Display 
for  Quality  Control  of  Digital  Cartographic  Data,”  SPIE  True  3-D 
Imaging  Techniques  and  Display  Techutlogies,  761:  146-152  (1987). 

HODG91.  Hodges,  Larry  F.  "Basic  Principle  of  Steieographic  Software 

Development,"  SPIE  Stereoscopic  Displays  and  Applications  II,  1457: 
9-19  (1991). 

HOLL92.  Holloway,  Richard  et  al.  "Virtoal-Worlds  Research  at  the  University  of 
North  C^lina  at  Chapel  Hill,"  Implementation  of  Immersive  Virtual 
Environments.  15.1-15.10  ACM  (July  1992). 

HUAN71.  Huang,  T.S.  "Digital  Holography,"  Proc.  IEEE,  59:  1335-1346 
(September  1971). 

JACX)92.  Jacoby,  Rick.  'Design  and  Implementation  Issues  in  the  View  Lab," 
Implementation  of  Immersive  Virtual  Environments.  5.1-5.11  ACM 
(July  1992). 

KIMW92.  Kim,  Won  S.  and  Paul  Schenker.  "A  Teleoperation  Training  Simulator 
with  Visual  and  Kinesthetic  Force  Virtual  Reality,"  SPIE  Human 
Vision,  Visual  Processing,  and  Digital  Display  III,  1666:  560-569 
(1992). 

LANE82.  Lane,  Bruce.  "Stereoscopic  Displays,"  SPIE  Processing  and  Display  of 
Three-Dimensional  Data,  367:  20-32  (1982). 

LIPT92.  Lipton,  Leiuiy.  "The  Future  of  Autostereoscopic  Electronic  Displays," 
SPIE  Stereoscopic  Displays  and  Application  III,  1669:  156-162  (1992). 

MOUS90.  Mouser,  Tom  et  al.  "Non-Fourier  Computer  Generated  Holography  for 
3-D  Display,"  SPIE  Practical  Holography  IV,  1212:  325-333  (1990). 

MUIR61.  Muirhead,  J.C.  "Variable  Focal  Length  Mirrors,"  Review  of  Scientific 
Instrumentation,  32:  210-211  (February  1961). 

RAWS69.  Rawson,  Eric  G.  "Vibrating  Varifocal  Mirrors  for  3-D  Imaging," 

IEEE  Spectrum,  6:  37-43  (September  1969). 

ROBB89.  Robb,  R.A.  and  C.  Barillot.  "Interactive  Display  and  Analysis  of  3-D 
Medical  Images,"  IEEE  Trans.  Med.  Imag.,  8:  217-226  (September 
1989). 


61 


R0BI91.  Robinett,  Wanen  and  Jannick  P.  RoUand.  "A  ConqiutaticMial  Model  for 
the  Stereoscopic  Optics  of  a  Head-Mounted  Display,"  SPIE 
Stereoscopic  DispUiys  and  Applications  II,  1457:  140-160  (1991). 

SHER88.  Sher,  Lawrence  D.  "SpaceGraph,  a  True  3-D  PC  Peripheral,"  SPIE 
Three-Dimensional  Imaging  and  Remote  Sensing  Imaging,  902:  10-16 
(1988). 

STAR92.  Stalks,  Michael.  "Stereoscopic  Video  and  the  quest  for  Virtual  Reality," 
SPIE  Stereoscopic  Displays  and  Application  HI,  1669:  216-227  (1992). 

STAU90.  Stuart,  Capt  Bryant  L.  Computer  Generated  Holography  as  a  Three- 
Dimensional  Display  Medium.  MS  thesis,  AFnyGCS/ENG/90D-14. 
School  of  Engineering,  Air  Force  Institute  of  Technology  (AU),  Wright- 
Patterson  AFB  OH,  December  1990. 

STYT91.  Stytz,  M.R.  et  al.  "Three-Dimensional  Medical  Imaging:  Algorithms 

and  Computer  Systems,"  ACM  Computing  Surveys,  23:  421-499  (1991). 

TRIC87.  Tricoles,  G.  "Computer  Generated  Holograms:  An  Historical  Review," 
Applied  Optics,  26:  4351-4360  (October  1987). 

UNTE87.  Unterseher,  Fred  et  al.  Holography  Handbook,  Making  Holograms  the 
Easy  Way.  Berkeley:  Ross  Books,  1987. 

WICH91.  Wichansky,  Anna  M.  "User  Benefits  of  Visualization  with  3-D 

Stereoscopic  Displays,"  SPIE  Stereoscopic  Displays  and  Applications 
II,  1457:  267-271  (1991). 

WICK90.  Wickens,  Christopher  D.  "Three-Dimensional  Stereoscopic  Display 

Implementation:  Guidelines  D^ved  from  Human  Visual  Capabilities," 
SPIE  Stereoscopic  Displays  and  Applications,  1256:  2-11  (1990). 

WILL91.  Williams,  Rodney  Don  and  Daniel  Donohoo.  "Image  (^ality  Metrics 
for  Volumetric  Laser  Displays,"  SPIE  Stereoscopic  Displays  and 
Applications  II,  1457:  210-220  (1991). 

WILL92.  Williams,  R.  Don  et  al.  "Direct  Volumetric  Visualization," 

Proceedings  of  Volume  Visualization  '92.  99-106.  Los  Alamitos  CA: 
IEEE  Computer  Society  Press  (1992). 

WILL92P.  Williams,  R.  Don,  PhD,  Director  Advanced  Technology  Entity. 

Personal  interviews.  Texas  Instruments,  Dallas  Tx,  7  April  through  IS 
November  1992. 


62 


Vita 


Captain  Bruce  A.  Hobbs  was  bom  on  12  April  1961  in  Hawthome,  Nevada. 

He  graduated  from  Mineral  County  High  School  in  Hawthome,  Nevada  in  1979  and 
attended  Arizona  State  University,  graduating  with  a  Bachelor  of  Science  in  Electrical 
Engineering  in  December  1983.  Upon  graduation,  he  entered  the  Air  Force  and  served 
his  first  tour  of  duty  at  Kirtland  AFB,  New  Nfexico.  He  served  as  Computer  Systems 
Engineer  at  the  Air  Force  Weapons  LaboratOTy  until  March  1987.  He  was  then  chosen 
to  serve  as  Chief  Electromagnetic  Pulse/Hydroacoustic  Engineer  and  later  as  the  Chief 
Atmospheric  Engineer  for  the  Engineering  Division  of  the  Technical  Operations 
Division,  Air  Force  Technical  Applications  Center  at  McClellan  AFB,  California.  In 
He  entered  the  School  of  Engineering,  Air  Force  Institute  of  Technology,  in  June 
1991. 


Permanent  Address;  230  S.  Grand  Drive 

Apache  Junction,  AZ  85220 


63 


obtain  Bruce  A.  Hobbs  was  bom  on  12  April  1961  in  Hawthcnne,  Nevada. 

He  graduated  firom  Mineral  County  High  School  in  Hawthorne,  Nevada  in  1979  and 
attended  Arizona  State  University,  graduating  with  a  Bachelor  of  Science  in  Electrical 
Engineering  in  December  1983.  Upon  graduation,  he  entered  the  Air  Force  and  served 
his  Erst  tour  of  duty  at  Kirtland  AFB,  New  Mexico.  He  served  as  Conq)utBr  Systems 
Engineer  at  the  Air  Force  Weapons  Laboratory  until  March  1987.  He  was  then  chosen 
to  serve  as  Chief  Electromagnetic  Pulse/Hydroacoustic  Engineer  and  later  as  the  Chief 
Atmospheric  Engineer  for  the  Engineering  Division  of  the  Technical  Operations 
Division,  Air  Force  Technical  Applications  Center  at  McClellan  AFB,  California.  In 
He  entered  the  School  of  Engineering,  Air  Force  Institute  of  Technology,  in  June 
1991. 


Permanent  Address:  230  S.  Grand  Drive 

Apache  Junction,  AZ  8S220 


63 


REPORT  DOCUMENTATION  PAGE 


form  Approved 
0MB  No  0704-0188 


_ 1 _ 

p.c  "•?  -“I.  :  <?.* «.  '.r  ^.e'•=»ce  *  •'Cui*  oe'- -espouse  ncoa’f'g  x"'e  ti*ne  ♦C' review  rg  e»  v..^c  aata  sources 

-c  **  •  '*e'?a?3  a'c  rcrroe:.'';  a^'c  -  e.'eA  rc  *“•»  ;r'  ‘■'X  ■r'  !'-^:r'r»at:c"  Sena  ccm'*>ents  fega'a>rg  t^'S  Ow’d-?'*  esX  'n  jte  :*  an,  :tner  asoect  ot  t^is 

. .  '  ■“.  ..r  *■;  T' .»••:»  -ec-  'f  5  ‘  x:  ng'r-n  ►^eaao-jrieri  Se'.ices,  C-  'e‘r?ra»e  ’: •  n^f.-irat’C''  Ooe'attcn^  a^c  Reo^  '■‘5.  12  Jefferson 

:;a.  i -■.•■'•  jt:-  anc  •.:*■'**  0**-e  :•' ‘.Xd-age"'eni  anc  Buogex  Pape'^orK  Reduction  Pro;ect  (C 'C4-3  *98)  /»'as*''ngtcn  DC  205C3 

1.  AGESCV  USE  ONLY  (Leave  blank)  2.  REPORT  DATE  3.  REPORT  TYPE  AND  DATES  COVERED 

1  December  1992  Master’s  Thesis 

!  4.  title  and  subtitle 

A  USER  INTERFACE  TO  A  TRUE  3-D  DISPLAY  DEVICE 

f 

5.  FUNDING  NUMBERS 

;  6  AU' HCKvi'i 

Bruce  A.  Hobbs,  Capt,  USAF 

7.  PERFORMING  ORGANi2A7lON  NAME(S)  AND  ADDRESS(ES) 

Air  Force  Institute  of  Technology,  WPAFB  OH  45433-6583 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

AFIT/GCE/ENG/92D-06 

9  S-y‘  ,  N  :  TCK.'.G  AGiNG-  NAME, S)  AND  ADDRESS(£S) 

10.  SPONSORING  MONITORING 

AGENCY  REPORT  NUMBER 

Sy  N  :■  ':S  • 

M:  :  ;  L-...  ■...  V  A  .A, yA?,i.:Ti  statement 

Approved  for  public  release;  distribution  unlimited 

12b  DISTRIBUTION  CODE 

12  AP  '  r.2  C'  <'T  ■  .V  'Cj: 

This  thesis  describes  an  interactive  interface  to  a  true  three  dimensional,  real-time 
dynamic  graphic  display,  the  TI  Omniview™.  The  system  generates  true  3-D  images  of 
volumetric  data  and  objects.  The  TI  Omniview  is  a  cylindrical  volumetric  laser  display  that  uses 
a  rotating  double-helix  translucent  disk  to  fill  the  display  cylinder.  Voxels  are  illuminated  on  the 

2-D  surface.  The  rotational  speed  of  the  disk  allows  the  viewer  to  fuse  the  2-D  images  into  a 
true  3-D  image. 

The  interface  provides  the  user  with  a  quick  and  fleTuble  means  of  manipulating  the 
image  generated,  the  sub-volume  displayed,  and  the  resulting  3-D  image.  The  interface  provides 
the  user  with  the  flexibility  and  convenience  that  a  window,  icon,  mouse,  and  pointer  graphical 
user  interface  provides  to  users  of  2-D  displays.  Limitations  of  the  device,  however,  do  not 
allow  the  use  of  icons  and  pointers  in  the  Omniview  display.  Instead  a  combination  of  voice 
commands,  a  joystick,  and  a  2-D  menu  system  running  on  a  host  computer  is  used  to  provide  the 
interface.  This  interface  allows  the  user  to  select  objects  and  scenes,  but  does  not  allow 
manioulation.  such  as  rotation  or  nlacement.  of  individual  obiects. 

U  SUL.iC’  TEKP; 

Three  Dimensional  Display  Systems,  Interactive  Graphics, 

Man  Computer  Interface,  3-D  Manipulation 

15.  NUMBER  OF  PAGES 

71 

16.  PRICE  CODE 

'17.  SECUR  ’Y  CLASSIFICATION  18.  SECURITY  CLASSIFICATION  19.  SECURITY  CLASSIFICATION 

0‘  REPOR*  OF  THIS  PAGE  OF  ABSTRACT 

UNCLASSIFIED  UNCLASSIFIED  UNCLASSIFIED 

20  LIMITATION  OF  ABSTRACT 

UL 

C '  5:0Q  Sta'-da'd  ^orr-  298  (‘»ev  2-89) 


by  iNS  s>a  239  '» 


29S-'C2 


